t 

t 



WO03021416 



Publication Title: 

METHOD AND APPARATUS FOR OBJECT ORIENTED MULTIMEDIA EDITING 



Abstract: 

Abstract of WO03021416 

A computer editing system for editing and creating a multimedia program in a 
visual workspace (1), which provides a plurality of segments of audio or video 
data, displays an icon (10) representing each of the segments, associates a first 
one of the segments (2) with at least one other of the segments, displays an 
indication of the association of the first to the other of the segments, thereby 
composing a program of the segments, wherein the program may be played in a 
sequence determined by a user in accordance with the associations. 

Data supplied from the esp@cenet database - Worldwide b49 



Courtesy of http://v3.espacenet.com 



This Patent PDF Generated by Patent Fetcher(R), a service of Stroke of Color, Inc. 



(12) INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 



(19) World Intellectual Property Organization 

International Bureau 

(43) International Publication Date 
13 March 2003 (13.03,2003) 




PCT 



(10) International Publication Number 

WO 03/021416 Al 



(51) International Patent Classification 7 : G06F3/00, 15/82 

(21) International Application Number: PCI7US02/27820 

(22) International Filing Date: 30 August 2002 (30.08.2002) 

(25) Filing Language: English 

(26) Publication Language: English 

(30) Priority Data: 

09/946,83 1 4 September 2001 (04.09.2001) US 

(71) Applicant: COMMAND AUDIO CORPORATION 

[US/US]; 101 Redwood Shores Parkway, Suite 100, 
Redwood City, CA 94055 (US). 

(72) Inventors: LINDEN, Thomas; 20420 Idyl wild Drive, Los 
Gatos, CA 95033 (US). SWERDLOW, Serge; 725 Cowper 
Street, #25, Palo Alto, CA 94301 (US). CHERNIKOV, 
Andrey; 20 Dolores Way, Orinda, CA 94563 (US). 



(74) Agents: ALLENBY, Christopher, B. et al.; Skjerven 
Morrill LLP, 25 Metro Drive, Suite 700, San Jose, CA 
95110 (US). 

(81) Designated States (national): AE, AG, AL, AM, AT, AU, 
AZ, BA, BB, BG, BR, BY, BZ, CA, CH, CN, CO, CR, CU, 
CZ, DE, DK, DM, DZ, EC, EE, ES, FT, GB, GD, GE, GH, 
GM, HR, HU, ID, IL, IN, IS, JP, KE, KG, KP, KR, KZ, LC, 
LK, LR, LS, LT, LU, LV, MA, MD, MG, MK, MN, MW, 
MX, MZ, NO, NZ, OM, PH, PL, PT, RO, RU, SD, SE, SG, 
SI, SK, SL, TJ, TM, TN, TR, TT, TZ, UA, UG, UZ, VC, 
VN, YU, ZA, ZM, ZW. 

(84) Designated States (regional): ARIPO patent (GH, GM, 
KE, LS, MW, MZ, SD, SL, SZ, TZ, UG, ZM, ZW), 
Eurasian patent (AM, AZ, BY, KG, KZ, MD, RU, TJ, TM), 
European patent (AT, BE, BG, CH, CY, CZ, DE, DK, EE, 
ES, FI, FR, GB, GR, IE, IT, LU, MC, NL, PT, SE, SK, 
TR), OAPI patent (BF, B J, CF, CG, CI, CM, GA, GN, GQ, 
GW, ML, MR, NE, SN, TD, TG). 

Published: 

— with international search report 

[Continued on next page] 



(54) Title: METHOD AND APPARATUS FOR OBJECT ORIENTED MULTIMEDIA EDITING 



< 

T-H 

l-H 




EE 



1 h 



A aM Crowa abo* 
Oatof* i 

Rum) Ctom to latino Minx* band, 30 
Odd Footcf GA*it». to Ton* Mt tvmm 
fw a concert cafebnvthQ 9m 15th bifttiday dt 
Sydney Ptt/ry, the daughter of Texas Gov 
Rfc* Pony. The Aug. 1 8 show al Sbjbb'a 
BBQ to Auaito wfl benefit Die cJy Setikmmt 



brirl U.S. Im by the Oeca* wkvwr"» band. 



Bd Chmtm and daughter Chafes* bounced 
to U7* beat at fee Mat) quartati US. (mate 
Friday rUgM to Eatl Rutnarftxd. N J. 



"H^ no*** preview tf)a movie Marry Aoffar 
Wadlwaday on AOi. (V*^*ort Harry Potter) 



•78 to IS H 




<A > □ OP M> j»o|<=»c» 



B 



2 (57) Abstract: A computer editing system for editing and creating a multimedia program in a visual workspace (1), which provides 
w ' a plurality of segments of audio or video data, displays an icon (10) representing each of the segments, associates a first one of the 

segments (2) with at least one other of the segments, displays an indication of the association of the first to the other of the segments, 
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METHOD AND APPARATUS FOR OBJECT 
ORIENTED MULTIMEDIA EDITING 

A portion of the disclosure of this patent document contains material which is subject to 
copyright protection. The copyright owner has no objection to the facsimile reproduction by 
anyone of the patent document or the patent disclosure, as it appears in the Patent and Trademark 
Office patent files or records, but otherwise reserves all copyright rights whatsoever. 

A computer program listing Appendix that includes a software program code executable 
on computer as described below is part of this application. 

FIELD OF INVENTION 

The present invention relates to a method and apparatus for editing and creating a 
multimedia program in a visual workspace. 

BACKGROUND 

Computer-based editing systems for video and audio information are well known, and a 
number of such systems are commercially available. These typically allow the user of the 
editing (or production) system, who is referred to as an editor or producer, to create and edit 
programs from segments or clips of video or audio, and which usually also include text and 
graphics material. 

In addition, it is known to include what are called links or hyperlinks in audio and/or 
video multimedia presentations. These links allow the viewer or listener of the program to jump 
ftom one program segment to another at his/her election rather than to merely listen or watch the 
program in a conventional sequential order. Such links are well known in the computer context, 
but are not so limited. 

For instance, see U.S. Patent Application No. 09/320,132, filed May 25, 1 999, entitled 
"Playing Audio Of One Kind In Response To User Action While Playing Audio of Another 
Kind", filed by William J. Loewenthal et a]., commonly owned with this application; and also 
see commonly owned U.S. Application No. 09,272,633, filed March 1 8, 1999, entitled "Program 
Links and Bulletins for Audio Information Device", filed by William J. Loewenthal et al, all 
incorporated herein by reference in their entireties. The above-referenced applications disclose 
use of links between various data files which are programs, or parts of programs, which 
advantageously allow the user to traverse from one data file to another data file depending in 
some embodiments upon predetermined context related relationships. This is analogous to the 
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hyperlinks well known in the computer field in, for instance, websites. Here it is used in the 
context of a radio-type audio receiver, and is also adaptable for a television-type receiver 
("Player")- Of course, this requires that the receiver include local storage for storing the program 
contents so that the user can navigate between the program segments. Also, see U.S. Patents No. 
5,406,626; 5,524,051; 5,590,195, all issued to John O. Ryan, and incorporated herein by 
reference in their entireties. 

Hence, while such linked audio programs are known and also, in general, computer 
editing of video and audio programs is known, in the prior art construction of such linked 
programs requires substantial effort even using computer based editing. 

SUMMARY OF THE INVENTION 

The present system allows the producer to more easily produce the programs by allowing 
him/her to make the associations ("links") between and among program segments in a visual 
workspace. The program produced is thereby not unidirectional (sequential in time only). The 
system allows the producer to edit the programs into a program that does not playback from 
beginning to end in a unidirectional (time) line, but rather, a program that has associations that 
allow playback of the produced programs in an order that is determined by the listener (i.e., the 
programs are interactive). Unidirectional editing as described above is known in the prior art 
(see e.g., U.S. Patent No. 5,892,507, Moorby et al., incorporated by reference in its entirety). 
This is a type of editing in which multimedia data can be linked together to be played back in the 
form of a story from beginning to end along a unidirectional (time) line. 

The present system is an improvement on this time-based editing process that producers 
have used in the past. The present system provides a visual workspace, on a single screen, that 
enables the producer to isolate the segments comprising any program, to convert these segments 
into objects, to establish non-linear (multi-dimensional) relationships ("links") between and 
among any number of such objects, and to prepare multimedia programs. The benefits of the 
system over the well-known, time-based editing process include the production of programs 
more quickly, the reduced need for technical expertise on the part of producers, and the 
improvement in the quality of programs. 

Hence, there is provided here a system suitable for creating and editing such complex 
linked programs using a graphical user interface which allows easy linking by ordering icons 
depicting the various segments on a screen, and providing on the screen a spatial indication of 
same. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 illustrates a sample screen of the visual workspace. 

Figure 2 illustrates a linking of objects coded with the markup language. 

Figure 3 illustrates a sample view of the composer of FIG. 1, containing header and detail 
content elements. 

Figure 4 illustrates a sample of a "Player" interface on a general purpose computer that 
can be used in conjunction with this invention to play the produced program. 

Figure 5 illustrates a flowchart of the production of a program using the present system. 

DETAILED DESCRIPTION 

According to an embodiment of the present invention, multimedia programs are created 
and edited (collectively "produced") using computer software that allows multimedia content 
(e.g., audio, video, text, graphics) to be displayed as objects on a screen associated with a 
computer. A simple-to-use visual workspace (graphical user interface) is used to produce 
programs with complex associations. The software runs on, e.g., a standard computer executing 
the Windows 2000 operating system and is coded, e.g., in the C++ computer language. 

Figure 1 shows a sample screen used interactively by the producer (editor)* who is a 
person. This screen 1 is displayed by the software executed on the computer. Coding this 
software in a suitable language is well within the skill of one of ordinary skill in the art in light 
of this disclosure. In one embodiment the software is an add-on module to the commercially 
available Multitrack Editor V3.98, part of the DigAS editing system available from D.A.V.I.D. 
GmbH of Germany. The producer views the multimedia files 2 or content in the content 
explorer 3. The content explorer 3 is a box on the screen that displays as icons the multimedia 
files 2 (program segments) available to the producer for editing. The producer can choose 
among available multimedia data files to produce programs. The file icons can be 
conventionally dragged and dropped (e.g., using a mouse associated with the computer) into the 
prompter 4, composer 5, and/or waveform editor 6 portions of the computer screen. The content 
explorer 3 contains icons for multimedia files 2, including audio, video, text and graphics files, 
as well as completed programs. This content (the actual program segments) could come from 
outside sources such as magazine articles, quiz shows, or audio/video sports and traffic updates. 
The content could also come from files or records in a computer database. Content is of the type 
available from LAN, local, and remote sources in, e.g., conventional .wav, .txt, .mp3, .jpg, and 
.rtf data file formats. 
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The composer 5, as illustrated in Figure 1, provides the producer with a visual workspace 
to produce programs. The composer provides a visual representation of the structural parts of the 
program. The composer has three viewing boxes. In these different boxes, the producer can 
drag and drop multimedia files for viewing or editing. First, there is a multimedia viewer 7, 
which displays the types of files that are contained in each segment 10. Second, there is a 
navigational viewer 8, where the navigational (or multidimensional) structure of the program, or 
the sequence of segments, is created. Third, there is a view box 9, in which the producer can 
view and edit the text or image files without having to open the individual files. 

In the composer 5, the producer can view the segments 10 available for program 
composition. The composer allows the producer to view and edit segments in the navigational 
viewer 8. The story or content in each segment icon is labeled so that the producer can edit the 
program without having to click each segment icon to determine its contents. There are also 
conventional search mechanisms to find a segment by its label. This is especially necessary for 
larger programs. Each segment 10 is conventionally represented by an icon. An unlimited 
number of content elements 1 1 (rectangles) are available in the navigational view 8. When the 
number of content element 11 sets reaches the edge of the composer view, the producer is able to 
further view the content element 1 1 sets .beyond the edge of the view by conventional scrolling. 
The properties of the segments 10 in the content elements 11, such as the name or length of the 
segments, can be viewed in a multimedia viewer 7 by suitably selecting a segment. The 
producer can insert, delete, and/or append segments in the composer 5. The producer can review 
and listen to (or view) the content layers (discussed below) within segments in the composer 5 
using the view box 9 and the waveform editor 6. The producer can examine segments in any 
order, moving back and forth or up and down between content elements, as illustrated in Fig. 3, 
and as explained in detail below. The producer can also listen to or view header content 
elements sequentially in the composer. 

The segments 10 are placed in the content elements 11. These content elements are 
shaped like rectangles in the composer's navigational viewer 8. The content elements 1 1 are 
empty until the producer places segments 10 within the content elements 1 1 . These content 
elements are arranged in levels. Figure 3 shows the arrangement of the content elements into 
header content elements 12 (top level) and detail content elements 13 (lower level). 

The content elements are either prime, meaning they contain only one segment, or are 
compound, meaning they contain more than one segment. A content element may contain any 
number of segments. Figure 1 illustrates examples of a compound content element 14 and a 
prime content element 15. When the content element contains so many segment icons that they 
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are no longer viewable on the screen, the producer can scroll within the content element to see 
the multiple icon segments in the content element on the screen at the same time. The producer 
creates the associations between and among these segments, which here include associations 
other than merely sequential in time. 

As seen in Figure 3, one embodiment of the composer provides a 'template" that consists 
of content elements for header information of a story and content elements for the details of a 
story. There are three types of programs that can be produced. The most basic type is a one- 
level program. The end user (who ultimately plays the produced program) can determine the 
order this program is played, scanning forward or backwards through segments. A complex type 
of program is a two-level program. A two-level program has (linked) headers and details which 
are both content elements. A header provides, e.g., a short introduction to a story. A detail 
provides, e.g., the body of a story. The content elements (icons) are arranged in a template in the 
composer to make it easier for the producer to make the associations in the program. A template 
can be spatially arranged to have header content elements 12 on the top level and to have detail 
content elements 13 on the lower level of the composer's navigational viewer 8. 

Another complex type of program is a three-level program. (The number of levels is not 
limited.) A template could also be arranged to have a third level of detail content elements. The 
producer uses this third level of detail content elements to arrange segments in the program 
which further relate to the header or details of the story. For example, the third level contains an 
advertisement for the program, along with an option for the end user to make a purchase. In this 
example, the producer could also place a segment with a video clip in the third-level detail 
content element that would play once the end user made the purchase. This third level of content 
elements is associated with either or both of the other two levels of content elements. 

The producer can via the user interface make any number of associations between and 
among the header content elements and detail content elements. For example, a header content 
element could be linked with one or more detail content elements. A producer could link these 
by introducing on the screen an explicit relationship graphic line between the header and each of 
the detail content elements. Alternatively, a producer could make a duplicate header content 
element (using conventional shading or coloring on the icon to indicate it is a duplicate) and 
copy it on the screen to a location above each of the detail content elements that the producer 
intends to be associated with the header content element. One detail content element could also 
be shared by (linked to) multiple header content elements using similar linking techniques. 

The prompter 4, as shown in Figure 1 , allows the producer to create text content and open 
an existing text file to put into a program. The prompter 4 is for viewing and editing text. Text 
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can be imported from a text file or word document or composed directly in the prompter 4. The 
prompter 4 can receive files from the content explorer 3 and from outside applications. The 
prompter 4 allows the producer to mark parts of the text with tags 16 (Figure 3). The producer 
can tag parts of text for re-evaluation later in editing process. The tags 1 6 will remain in the 
prompter 4 as long as any of these remain in text. When the text is recorded into audio (using, 
for example, conventional text to speech methods), the recorded audio would be automatically 
separated into individual segments based on the tags 16 placed in the text 

As illustrated in Figure 1, the visual workspace also contains a conventional audio 
waveform editor 6. The waveform editor 6 allows the producer to edit audio files and segment 
audio programs. 

Segments of multimedia data are conventionally created by the producer. The producer 
places a content layer or multiple content layers of multimedia data in the segments. The 
producer can drag and drop multimedia data files 2 (content) from the content explorer 3 into the 
individual segments that make up a program. Figure 2 illustrates in a chart the content layers 18 
that make up a segment (Figure 2 is for conceptual purposes and is not part of the user interface). 
Each content layer contains multimedia data. Content layers 18 may contain either audio, video, 
text or graphics data. 

The editing system also enables the producer to apply differing conventional compression 
techniques to each content layer within each segment. Different content may need to be 
compressed at different rates in order to minimize bandwidth consumption in the system. For 
example, if an audio layer contains music and speech, an author using the editing system can 
apply a different compression to the music and the speech. 

After the segments are edited by the producer in the visual workspace by manipulating 
their icons, in one embodiment the segments are coded in a markup language. This is done to 
provide an exportable file using the markup language (ML). MLs are routinely used in this 
context for exportable computer files. Figure 2 illustrates the associations that the markup 
language allows between the segments. The segments are coded by the ML so that they can be 
represented as objects 17. The objects 17 are segments, coded with the ML. After coding with 
the ML, the segment is an object 17, composed of content layers 18. These objects 17 contain 
the same audio, text, graphics or video content layers 18 that were in the original segments. This 
markup language establishes relationships between and among objects (using well-known 
hyperlinking technology). The ML also enables the graphical user interface ("GUI") on the 
associated "Player" to interact with the content layers of the objects. The Player is a receiver 
unit, as described in the above-referenced patent applications, to which an embodiment of this 
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invention delivers the programs edited by the editing system. The graphical user interface 
depicts a ML multimedia object composed of ML descriptions 19. Thus, the editing system 
allows the producer to assemble a markup language multimedia object from multiple source 
components. 

Once the program is completed, the program can be played in the visual workspace on a 
general purpose computer using a Player application program, or can be played using the 
physical dedicated Player device. The computer requires the Player application to play the 
program. An example of a Player application program interface 20 on a general purpose 
computer is illustrated in Figure 4. The Player interface 20 has a small screen and various 
controls as illustrated. The editor or end user can listen to the header of a story and can listen to 
the details of that story by pressing the "more info" button 20a on the Player interface 20. For 
example, if the end user is listening to a story about Tiger Woods, and mention of his equipment 
is made in that story, the end user can press the "more info" button 20a on the Player interface 
and hear about the equipment Tiger Woods uses and could also hear an advertisement for this 
equipment and even make a purchase of the advertised equipment. The user could also 
simultaneously watch footage of Tiger swinging a golf club in the viewing screen 20b of the 
Player. If the editor or end user does not want to listen to the details of a story, he can continue 
listening to the default program of continuous header story segments that the producer has 
produced using this invention. Other default programs may be produced; the producer could, for 
example, produce a program that would play the header and each detail of a story even if not 
prompted by the user. The dedicated Player is of the type described above and has similar 
functionality as interface 20. 

The present system allows the producer to more easily produce linked type programs by 
allowing him/her to make the associations between and among program segments in a visual 
workspace. The process of creating associations is made easier because the producer can not 
only arrange the stories in content elements, but can also see the segments and what they contain. 
Thus, for example, in a header content element, the producer can see there is a heading segment 
of a story about Tiger Woods winning a tournament, and in the detail content element there is a 
segment about the details of the story about Tiger winning a tournament. Further, the producer 
can see that a segment (or segments) in a third-level detail content element contains an 
advertisement for golf clubs in which the end user could, for example, make a purchase or watch 
a video of Tiger using the golf clubs being advertised. 

Figure 5 illustrates a flowchart of the production of a program using the present system. 
First, program content or multimedia data files are stored in a local database 22 associated with 
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the editing computer. The producer uses these files to produce programs in the visual workspace 
21. When production is complete, the programs are saved in the database 22 and notification is 
sent to the ML generator 23 (which is the ML described above). The ML generator 23 retrieves 
the programs from database 22 and codes the program with the markup language. The resulting 
marked-up program is saved in a new database 24 also associated with the editing computer. 
The distribution system 25 is then notified that the program is complete. Distribution system 25 
is, e.g., a wireless broadcast system, such as the system utilized by the Player, as described in the 
above-referenced patent applications. Distribution system 25 can also be, e.g., an internet 
system, such as the system utilized by an internet based version of the Player. In addition, the 
distribution system 25 can be, e.g., a physical data storage media such as Compact Flash, Tape, 
or Compact Disk. Finally, the Player 26 receives content from the distribution system 25 and 
stores the content in its local database 27. The stored content is then available for interactive 
playback through the Player's 26 graphical user interface. 

The computer program listing Appendix, which is a part of this application, includes a 
description including computer code of the markup language described above, and is entitled 
"CAML: Command Audio Markup Language Specification." The Appendix also includes 
computer code, and descriptions thereof in the form of comments, to carry out the system in 
accordance with this disclosure. That description is entitled "On-Demand Authoring (ODA) 
Studio Design Specification." 

Having described the embodiments of the invention, it should be apparent to those skilled 
in the art that the foregoing is merely illustrative and not limiting, having been presented as an 
example only. Modifications and other embodiments are within the scope of one of ordinary 
skill in the art and are contemplated as being within the scope of the invention as defined by the 
following claims. 
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1. CAML Language 
l.l. Abstract 

The Command Audio Markup Language (CAML) is designed to meet the Metadata definition needs of audio- centric interactive 
multimedia distributed over wireless digital audio broadcast (DAB) ays tens to mobile and stationary consumer devices. By 
Metadata, we generally mean data about content, such as the broadcast time of an audio program or that this edition of Nightline 
" has five stories. Using CAML, an author of a CAML document can combine and interrelate multiple audio-centric media objects 
into compelling presentations. In automobile driver and other 'eyes on the road, hands on the wheel' environments, only tho 
audio layers of the rich media are expected to be available to consumers. Thus, the audio- centricity of the specification (as 
opposed to video-centric definitions such as MPEC4 or MPEG7) is a core fundamental requirement. The media objects may include 
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Interactive capabilities, but these should not mandate & driver' a attention (e.g. to play a media selection or to complete an 
advertised purchase). In order to experience these multimedia objects independent of the broadcast schedule (i.e. as on-demand 
or time shifted madia), there is no requirement for real- time presentation. 

5 DAB systems are distinguished in that they are one-way, point to multi-point transmission systems. These systems have an 

inherent, fundamental advantage over point to point transmission systems (e.g. wireless internet systems) by allowing a single 
broadcast to reach an unlimited number of receivers at no incremental bandwidth cost. DAB systems also exhibit unique data loss 
characteristics (e.g., data loss when obstacles block reception). 

10 The CAKL language ia designed to meet the following criteria* 

1. The language definition is open, flexible, extensible and able to represent complex object relationships. 

2 . A rich set of presentation capabilities is available to media authors . 

3. The authored media is suitable for distribution over wireless DAB systems to mobile devices. 

15 4. The presentation of CAML, media is efficient and interoperable on low-power, portable consumer devices. 

5. To obtain optimal advantage of dab systems, CAML object distribution needs to be resilient to (some degree of) data loss. 

6. It is suitable to define both program contents and electronic program guides (the penultimate metadata for broadcast audio -or 
video- services) 

20 To achieve these criteria, the euthora observed a similarity between the criteria for CAKL and to Internet streaming media 

technologies such as RealServer and Real Player by RealNetworks, inc. and windows Media server and Player by Microsoft, Inc. For 
streaming audio, these Internet technologies are audio- centric. They may incorporate other madia as non-essential presentation 
elements. a noted difference is that internet streaming media allows a server to choose alternative compression streams based 
on the dynamic performance of the Internet connection to each client. With DAB systems, there is no variance of bandwidth 

25 (performance) on a per client basis. An additional distinction is the desire to enable consumer navigation capability over the 

audio-centric object. That is, consumers should be able to follow audio-centric document relationships using simple navigational 
interfaces which do not require visual clues such as underlined or color -based textual linkages requiring a mouse or keyboard 
centric interface. 

30 As a starting point, the authors chose the Synchronized Multimedia Integration Language (SMIL) 2.0 specification. Thus, CAML 
contains a subset of the SMIL 3.0 features including basic layout, linking, media object, structure, and timing modules, and a 
set of CAML unique extensions that enable rich navigation and semantic linking between media segments. 

1.2. Introduction 
35 This section is informative. 

The design of wireless digital audio broadcast systems has traditionally focused on delivering high- fidelity real-time audio to 
consumers in mobile and stationary environment B . Examples of such systems arei 

40 » the satellite digital audio radio system (SDARS) developed by XM Satellite Radio 
? the SDARS developed by Sirius Satellite Radio 

? the terrestrial in- band, on- channel system developed by iBiqulty Digital corporation 

? the European Telecommunications Standards Institute <KTSX) standard for Radio Broadcasting Systems j Digital Audio Broadcasting 
(DAB) to mobile, portable and fixed receivers. EN 300 401 VI .3. 2 {commonly known as Eureka- 147) 

AtS 

The Command Audio Markup Language was defined to provide a uniform standard- based definition which extends these systems to allow 
services that deliver additional, richer, but still audio -can trie, media for time -shifted presentation. Such services are termed 
On -Demand Interactive Audio (ODIA) services. The CAML language serves as a standard representation for multimedia On-Demand 
interactive presentations over dab systems. Note that systems which implement ODIA services can Include capabilities to 
50 represent both real-time and non- real- time content and to allow time-shifted presentation of both. 

CAML content providers may distribute their content over a variety of channels, the digital audio broadcast channels mentioned 
above, conventional AM or FM analog channels, or two-way wireless or wired channels. SPG providers may distribute their content 
^ over the same or different channels as the content providers. 

CAML content providers may present their programs on a wide variety of clientB, such as ODIA- enabled digital audio broadcast 
radio receivers, DAB receivers integrated with mobile phones, car navigation systems, and voice ueer agents. Each of these 
platforms (or integration of platforms) has its specific capabilities and may require its own flavor of cahl presentation, caml 
60 does not define the actual device presentation/ it defines the media object and relationships. 

To achieve its interoperability and portability goals, CAML includes a number of capabilities from the Synchronized Multimedia 
Integration Language (SMIL) 2.0 defined at httpi//www.w3 .org/TR/2Q01/WD-smil20-200l0301/ . The SMIL modularisation provides a way 
to create profiles (subsets) of the full SMIL language, in addition to providing the means to integrate SMIL functionality into 
65 other languages. In particular, the set of SMIL modules used in CAML represent the SMIL Basic Profile as defined at 

httpt //www. w3.org/TR/200i/WD-smil20-200i030i/smil -basic. html. But, SMIL 2.0 defines a number of capabilities (e.g. complex timing 
with vidao objects) which are not appropriate given the CAML objectives. Future editions of this document will identify specific 
basic profile elements are not required by CAML. In addition to the SMIL modules, CAML also includes extensions that enable rich 
navigation and semantic linking between audio-centric media segments. 

70 

This document presents a fixed CAML definition to maximize portability. We can anticipate that in the future, like SMIL profiles, 
a CAML profile for ODIA -enabled devices can be tailored based on the full CAML language with or without extensions to support 
application specific features. 

75 CAML documents represent either the metadata associated with media to be listened- to by consumers (e.g. editions of audio 

programs) or the metadata describing the selections of media available to consumers. The metadata describing selections is 
generally referred to as an Electronic Program Guide (or EPS) . Since the media experience of consumers of CAML described content 
is audio- centric, it is a complementary requirement that the BPQ also be audio -centric. -mat is, the program guide used for 
personalisation of a ODIA- enabled device should have a presentation which is consistent with all other CAHL objects. In this 

80 respect, there are similarities between an BPG for audio-centric services and an epq for video-centric services. The TV- Any time 
Forum is creating international consensus on definitions for systems which enable video- on- demand capabilitiee . These include 
META definitions for a Program Guide. Where practical, we have chosen to adopt several of these features as port of the CAML 
definition. 

85 It should be noted that the caml definitions, SMIL definitions and rv-Anytime definitions, per ee, make no statement regarding 
IPR regarding implementation of systems incorporating these features. It is anticipated that this document (or future versions 
thereof) will be contributed to standardization bodies such as WorldDAB (http :// www. worlddab.org/ ) , the Wireless Multimedia Forum 
(httpt //www. wmraforum.com/) , and TV-Anytime Forum (http* //www. tv-anytime.org/. Such submission makes no representation as to 
specific Comnand Audio or other organieetion' a product capabilities, copyrights or intellectual property rights. 



90 



For information and specifications regarding TV- Anywhere the reader io referred to httpt //www. tv-anytitne. org/ . 

For information and specifications regarding SMIL the reader is referred to http://www.w3.org/TR/REC-smil/2000/SMiL20/. 



That a player is CAML conformant means that it can play documents at lease as complex as those allowed by the CAML language 
95 definition. 
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This document is expected to expand in future version to incorporate met a information describing consumer metadata such as usage 
history, user preferences, and transactional media layers for interacting with 2 -way baokchannels . 

2. Design Rationale 
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This section is informative. 

CAML language may be supported by a wide variety of ODIA- enabled players running on multiple hardware platforms. Mobile and 
portable devices share noma common characteristics? 

LCD display i display can render only texts in a small area {for example a radio with two lines of twelve characters each) . 

simple input method. Input devices may be functional, arrow keys, and a select key. Another may have a voice interpreter. 

Audio- centric i The primary interaction with players is audio only. That is, no textual or graphical viewing is required to 
interact with the object rendering. 

The CAML language aims to meet these requirements. 



2.1. Navigation 

A Caml document consists of one or more content items, represented in CAML language constructions. CAML constructions are used 
primarily to implement navigational capabilities of ODIA content. At the level of primary segments SMIL, modules are used. Bach 
SMIL module is an XHL subtree which, taken separately, fully conforms to the definition of a SMIL 2.0 Basic Profile document. 
20 a. 3. Layout 

Layout coordinates presentation of objects oa the display device. Layout directives in CAML will be defined using SMIL modules 
(see Appendix A) The SMIL BaoicLayout Module is used and the more complex functionality of the other layout modules, such as 
hierarchical layout regions, is not supported. 

2.3. User Interface 

25 In an ODIA player device, a user would likely use radio-like dials to select the target that activates playback or linking. A 

■mouse -like" pointing cursor device is generally not supported. While a user is handling the focus, the player may slow or pause 
its timeline; skip to the next segment r traverse to additional information and perform other navigational movements. 

2.4. Timing and Synchronisation 

30 Timing and Synchronisation aspects of CAML presentation are bandied using SMIL modules (Appendix A) . The SHLL Timing and 

Synchronisation Nodules present dynamic and interactive multimedia according to a timeline. The SMIL timing model is expressed in 
a structured language. The timeline of a SMIL Basic Profile presentation may need to be processed with limited memory and 
processing resources of mobile devices. For example, recursive function calls caused by nesting elements and memory allocation 
for additional timelines should be restricted. To achieve this, the CAWL language has restrictions on use of the SMIL Timing. 



The restrictions are i 

Begin or end conditions are not allowed. 
Hon- root time containers are not supported. 



Time attributes support the basic timing for an element. Timing attribute values support a synchronization-based timeline. Simple 
event timing is useful and is usually easy to support, and so is included in CAKL. 

2.5. Media Object 

Location of the media that constitute the contents of the presentation in CAML is defined using SMIL module BasicMedia. The ODIA 
45 multimedia presentation is composed of media such as audio, text, images, animations and video. 

2.6. Content Control 

The CAML language includes the SMIL BasicContentControl Module. Por the sake of authoring consistency, a CAML document should be 
able to contain several presentations for different kinds of clients, controlled by switch elements end test attributes. 

50 

The player should analyze swLtch element syntax correctly even if it cannot recognize the tost attributes' values. 

2.7. Accessibility 

55 The document, "Accessibility Peatures of SMIL" tWAl -SMIL- ACCESS) , summarizes their recommendations on the SMIL 1.0 [SMIL1] . 

3. Definition of the CAML Language 
This section is normative. 
3.1. Conformance criteria 

60 A CAML document is a "Conforming CAML Document" if it adheres to the specification described in this document including CAML DTD 
and alsot 

? The root element of the document is a caml element. 

65 ? Conforms to the "extensible Markup Language (XML) 1.0 M [XML10J and % Uamaspaces in XML" specifications, the document is well- 
formed. 

T A document must declare a default namespace for its elements with its xmlns attribute ot the caml root element. A CAML document 
is identified with httpi //www.tobedetermined URI. 

For example* 

<caml xmlns -'httpi// www. tobedetermined n > 
</caml > 

If you wish to use SMIL modules that are not specifically included in the CAML language definition, you must identify them as 
being from the SHIL 2.0 namespace. Certain limits on CAML extensions should be applied (to be defined) 



80 A document may also Identify itself as a valid CAML XML document with a DOCTYPE declaration, although a CAML document must still 
include the above CAML namespace identifier. 

The CAML language DOCTYPE 1st 
-clDOCTYPS caml 
85 PUBLIC --//W3C//DTD SMIL 2.0 Basic/ /EN" 

httpi//www.tobedetermined/CAML.dtd > 

This DOCTYPE declares a valid, extension- free, CAML document. 



The rules above will be updated once an XML Schema for CAML language is available. 



conforming caml Players 



The CAML player is a program that can parse and process a CAML, document and render the contents of the document onto on output 
95 medium. 
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The following criteria apply to "Conforming CAML Players" i 

The player must conform to functionality criteria defined in each module in ways consistent with this profile specification. 
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The player should oupport the semantics of all CMC language features. The player ignores unknown elements under support of skip- 
content attributes. The player ignores unknown attributes. 

For an attribute with an unknown attribute value, the player substitutes tbe default attribute value if any. or ignores the 
attribute if the attribute has no default value. 
3.3. caml Language 

The CAML language supports the lightweight multimedia features defined in the SMIL 2.0 specification. It includes the following 
SMIL 2.0 Modules. 

SMIL 2.0 Layout Modules BasicLayout 
SMIL 2.0 Linking Nodules -- BasicLinking 

SMIL 2.0 Media Object Modules BasicMedia and MediaClipping 
SMIL 2.0 Structure Module Structure 

SMIL 2.0 Timing and synchroni ration Modules -- BasicinlineTlming, 

SyncbaseTiming, Event Timing. WinMaxTiroing , and BaaicTimeContainers 
SMIL 2.0 Content Control Modules BaaicCententControl and 
SkipContentControl* 

These collections of elements are used in the following sections defining the CAML content model* 

Collection Name Elements in Collection 

IiinkAnchor a, area (anchor) 

Medi eContent Text, img, audio, video, ref, animation, text stream 

Schedule Par, aeq 

EMPTY 

Collections of attributes used in the tables below are defined as follows t 

Collection Name Attributes in Collection 
Core Id, class, title 

Timing Begin, dur, end, repeat Count, repeatDur, rain, 
Max 

Description Abstract, author, copyright 

IlBn Xml tlang 

Test SyBtemBitrate(system-bitrate) , aystemCaptions (system- captions) ,oyo temLenguage<sye tern- language ) , 

SystemOverdubOrSubtitle ( system- over dub -or- caption) , 

SystemRequiredf system- required) , systemScreenSiae (system-screen- sise) , 
SystemScreenDep th ( system- a creen - depth) , sys temAudioDes c , 
SyetemCpe rating System, systemCPU, systenOomponent 

3.3. caml Data References 

CAML data references are special constructs that enable the CAML document to refer to specific parts of a chunk of binary data by 
specifying the starting offset and sise of the part being referred. The goal of introducing this construct. is to enable a CAML 
player to quickly locate binary data for media playback without having to scan large extents of binary data in search for 
specific boundary markers. It is recommended, therefore, that all binary data pertaining to a single CAML document be combined 
into one binary chunk that accompanies this document (although CAML allows to refer to more than one binary chunk using the 
chunks' IDs) . 

The specific mechanism of transferring binary data and associating binary chunks with CAML documents is implementation dependent; 
however, any conformant CANL player must be able to parse CAML data references and be able to locate the specified fragment of 
data in the binary chunk (s) which accompany the current CAML document. 

3.3.1. CAML Data Reference Attributes 

A CAML data reference consists of a number of attributes as defined below t 
arc 

The name of tne binary chunk. The value of src is normally equal to * caml: this", thus referring to the data chunk attached to the 
current CAML document. Other values of this attribute with % caml:* prefix refer to other binary chunks accessible to the 
document. Also, this attribute can contain any other valid URI which is processed according to the SMIL specification ISMIL2) . 

An example of a media object element with a ore attribute using CAML data reference t 

< audio id-" 9" src-" caml ■ this* caml. off set- "IDS 7914" caml* length- "S3 360" caml* channels- » I" caml* samplerate-'B 000" 
camltbitBperBample* n 16" caml * codec type»' PCM" /> 

3.3.2. Layers and blocks 

Audio layers consist of blocks which differ by the audio compression method used. Audio blocks are represented by <audio> 
elements and grouped together using<seq> elements corresponding to audio layers. 

Along with the attributes described in the SMIL specification, the audio elements may have the following CAML- Bpecif ic 
attributes > 

id 

A unique identifier of the block in the CAML document 
caml: offset 

The starting offset of the block, in bytes, relative to the start of the CAML binary chunk. 



caml t length 

The length of the block in bytes, 
caml i playtime 

The length of the block in milliseconds 
caml i channels 

The number of audio channels in the block, e.g. 1 for mono, 2 for stereo audio, 
caml * eamplerate 

The number of samples per second in the audio block, 
caml i bitspers ample 

The number of bits per sample in the audio block, 
caml i codectype 

The compression type of the audio block. Possible values are. 

The example of an audio layer with block information i 
<seq ti tle-~Hl-l.wav > 
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caudio id-"9" orc-'camlithie* caml » offset- "1067 914" caml .length- "533 60" caml i channels-":. • caml »samplerate- ,, 44l00" 
cana*bitspersaraple=*i6" carol: codec typeo"DVSI" /> 

<audio td-»io» grco"camit this* camltoffHet•'»ll21274 ,, canli length- "53360" caml x channels^ ■ 1 " caml iBamplerate-" 8000" 
camlsbitspersamplea"l6 w caml i codec type- -Dolby /> 

</seq> 

3.4. Navigation Module _ „ t 

The navigation module is the top layer of a CAML document providing means for navigating across media segments (SMIL modules) . 

Elements Attributes Content Model 

Caml Core, IlBn, caml -length, dialect (content- it em+) 

Contient-item Core, 118n, type, contentid, expiration-time, edition- time, announce -time 

(segment*) 

Segment Core, Il8n, next_story, prev story, next_primesegment, prev jprimesegment , down^level, up_ level, first, last, level, 
assoc_content_id, eif_type, EPG_title,~8tatus_raask, availability_prompt , prompt_alias Sail 

3.4.1. The caml element 

The caml element is the root element of a CAML document, it contains content- item elements and has the following attributes! 
caml -length 

Length of the CAML document in bytes, 
dialect 

The identifier of a CAML dialect used in this content item, e.g. 'Eurekal47* . (reserved for future use) 
3.4.3. The content- instance element 

The content -item element represents any version of a program (as per TV-Anytirae) that has been created by applying minor 
editorial changes to the content, (e.g. editing out explicit material) It contains at least one segment element. 

type 

Content type, e.g. "program", •EPG" or 'systemjprompts" . 
contentid 

Unique id of the content item identifying the program in the content database, 
expiration- time 

Time when the content is considered expired, in the format *MM/DD/YYYY hhiMN: SS" . 
edition- time 

Time when the content item was last edited, in the format •mm/dd/ytyy HH;MM:S3*. 
announce- time 

Time when the content item is to be available for transmission, in the format 'mm/dd/yyyy hh:mm:ss~. 
3.4.3. The segment element 

The attributes of the segment element are defined as follows i 
down level 

The value of the id attribute of a segment element one level down from the current segment in a muZti -level program. 

The^value o£ the id attribute of a segment element one level up from the current segment in a multi-level program. This attribute 
might be redundant (tbd) . 

prev story 

The value of the id attribute of the first Begment element in the previous story of the program. 
next_story 

The value of tha id attribute of the first segment element in the next story of the program, 
pxev^priraesegmant 

The value of the id attribute of the previous segment element in the current story, or, if it is the first segment of the story, 
it is equivalent to prev_story. 

next prime segment 

The value of the id attribute of the next segment element in the current story, or, if it is the last segment of the story, it is 
equivalent to next_story. 

first 

The value of this attribute is equal to *yes* if it is the first segment of a story, 
last 

The value of this attribute is equal to *yes" if it is the last segment of a story. 

The°value of this attribute is equal to 0 for segment elements belonging to the fixst level of a multi-level program, and it is 
equal to 1 for segment elements belonging to the second level. 

3.4.3.1. The segment element of BPG 

The segment element of a content item of type % EPQ» has additional attributes: 

. as8oc_content_id 

Contentid of a topic/program associated with the content of the 

cif_type 

Content class type, which can have the following values « 

7 



? Systeo\_prompt 
? Trafficjaulletin 
7 Newsjbulletin 
7 emergency bulletin 
7 undefined 

status mask 

A flag defining specialised rendering of the epo item associated with the segment. Possible values arei 

T disable_aave 

7 iavieible_on_epg 

aval labi li ty_promp t 
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Rofa ranee to the system availability prompt (id of the segnent containing the prompt in • system prompts* program) 
3.4.3.2. The segment element of System Prompt program 

The segment element of a content item of type *system_prorapts* has two attributes in addition to attributes common to all content 
items i 

5 

prompt_aliae 

An alias name of the system prompt associated with the segment. 
asaoc_content id 

10 Content Id of a prompt associated with the content of the segment. 
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4. A CAMX. document example 

The structure shown on this diagram is implemented in the following caml document* 



«?xml version* "1.0" encoding* "ua-aecii** ?> 

- <caml versions* "1.12" xmlnstcamla"http»//www.commandaudio.com/caml' , dialects. "navigator* caml- length* "5444" > 

20 - « content -i tern type -"program" title-" Tee cCaseS" contention "99999" expiraticn-time-"06/30/2003 00t00t00" edition-time»"07/23/2001 
23i43i22" announce-tinieo" 07/23/2001 23i43i22"> 

- <oegment id- "3" next_story-"17» next_priraesegmentt»"17 n dovn__level-"7» level-" 0° last- "yes » first- "yes ■> 

- <smil xmlna-"http*//www.w3.org/TR/aEC-smil"> 

- <body> 
25 - <par> 

- <seq title-"hl_l.txt ,, > 

<text id-"4" ore-" caml* this" caml t off set-" 0" caml i length- 0 12 7" /> 
«/seq> 

- <seq title«»"hl_l.wav' , > 

30 <audio id="6" src-"ceml .this" caml s of faet-"127" ceml» length- '1891020 » caml .channels-" 2" caml«samplerate-"44l00" 

caml tbitsper sample-" 16 M caml: codectype="PCN" /> 

«/seq> 

</par> 

</body> 
35 </smii> 

</ segment > 

- < segment id- "7" next_story-"17 w next_priraesegment-"ll» level-" 1" £irBt- w yes w > 

- <smil xmln8» n httpt//www.w3.org/TR/REC-smil-> 

- <body> 
40 - <par> 

- *seq title-«dl_l.txt«'> 

<text id-»8» sre-" caml t this" caml i offset- "1891147" camlilength=>"179" /> 
</seq> 

- <seq title-»dl l.wav** 

45 < audio id="10 a ~8rc-"caralsthis B caml » offset- "18913 2 6" caml i length- "22 s 137 2* caml t channels- "2" caml i samp lerate*" 44100" 

caml i bi tapers ample- "16" caml « codec type- * PCM ■ /> 

</seq> 

c/par> 

</body> 
50 </smil> 

</ segment* 

- < segment id««il» next_story- n 17" next jp rime segment 17 " prev_prime segment- "7" level-" 1" laste"yes n > 

- <erail xfolns-»httpi//ww.w3.org/TR/RBC-smil«> 

- <body> 
55 - <par> 

- <seq title-"dl_2.txt"» 

<text id-"12'' src="caml»this" caml toff set- "4 172 6 98" camlilengtb-"l07" /> 
</seq> 

- <seq title- • dl_2_S.wav > 

60 <audio id- "14" sre- ■ caml i this" caml i of f set- "4172 8 05" caml i length- "42 9248" caml : channel e» n 2 " caralisaraplerate="44100 n 

ceml^bifcspersaraple="16 ,, caml .codec type- "PCM" /> 

</seq> 

</par> 

</hody> 
65 </smil> 

</ segment > 

- <segment id=»17" next_story- M 31" next _pri^>eBegment» M 21 ,, prevjprimesegment-"3" previa tory=" 3" down_level-»25" level-"0" 
f irst* , 'yeB"> 

- <smil xmlna-"httpt//www.w3.org/TTi/REC-smil"> 
70 - <body> 

- <par> 

- <seq title- "h2 l.txt"> 

<text id-»18" src-"camlithis" caml i offset- "4602053" caml : length- "7 6" /> 
</seq> 

75 - <eeq title-"h2_l.wav n > 

<audio id-"20" src-"caml sthis" camljof feet* "4602 129" caml » length- "3073 88" caml* channels- "2" caml:saraplerate-"44100" 
caml i bitsper sample- "IS" eamlicodectype- ,, PCM» /» 

</seq> 

</par> 
80 </body> 

</smil> 

</ segment* 

_ < segment id- "21" next_stcry-"3l« nextj?rimesegment- n 31" prev_primesegment-"17" prevjBtory-"3" down_level-"25" levelo«o» 
last- "yes »> 

85 - <smil xnans- M http»//www.w3.org/TR/REC-smil»> 

- <body> 

- <par> 

- <seq ti tie- ■ h2_2.txt"* 

«text id-" 23" src»"aaml • this" caml? of f set- "4 909517 " caml i length- "117" /> 
90 </seq> 

- 4oeq title-* b2 2.wav"* 

<audio id-»24»~src»"caml tenia" camlioffset-"4909634» camitlength-"1493416" caml » channels-" 2" caml i samplerate- " 44100" 
camltbitspersample-"16" caml .codec type- "PCM" /> 
c/seq> 
95 </par> 
</body> 
</smil> 
</ segment* 

- <Begment id-"25" next story-"3l" next_orimesegment-»31« prev_primesegment»"3» prev_story»"3" level- "l" last»"yes" first—yes"* 
100 - <smil xmlns-«httpt//www.w3.orgyTR/REC-smil n > 

- <body> 
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- <par> 

- eseq titles-d2_l.txt"* 

ctsxb id>"26« sre- " caml i this" caml. of f set»"64030SO» camlt lengths "B8" /> 
</seq* 

5 - <seq titie«"d2_l.wav»> 

<audio id-"28" oro'camli this" caml iof f oet- "6403138" caml • length- "43 B 6430 " caml • channels -"2 » caml iGamplerate- "44100" 
carol tbitflpersample*>"i6" caml scodectype-" pcm" /> 
</seq> 
</par* 
10 </body> 
c/ stall* 
c/ segment* 

- oegment id-"3l" next_primesegi»ent-"35" prev_primesegment»"l7" prev_story«"l.7" dovn_level«"39» 1 level- "0" f irsto"yes"> 

- <emil xralns- p httpi//wwv.w3 .org/TR/REC- stall "> 
15 - <body> 

- <par> 

- <seq title- "h3_l.txt"* 

<text id- "32" src»"camltthie" caml* offset- "1078 9618" caml* length- "105 • /> 
</seq> 

20 - <aeq title- "b3 l.wav"» 

<audio id» B 34"~src«»camltthls" caml » of f set- "107 8 9723" caTnlilength»"490S36" caml » channels- •2" caml isaraplerete- "44100" 
caml « bit spar sample** "16" carol icodactype*" PCM" /» 

</eeq> 

</par> 
25 </body> 

</sndl> 

</ segment > 

- <aegment id»"35" prev_primeBegment«*3i" prev_story.»«l7" <town_level»"3S" level«"0" lasto-yee"* 

- <sroil strains* °httpi //www. w3 . org/TR/RBC-srail" :> 
30 - -sbody* 

- <par> 

- <eeq title- "h3 2.txt" > 

<text id>"36" ere- "caml* this" caml i off set- "112 8 0259" caml i length- "147" /* 
</eeq> 

35 - <seq title°"b3 2.wav"? 

<audio id= " 38 »*"srca "camlt thia" caml toff set- "11280406" caml i length-" 3 55572" caml « channels- "2" caml isamplerate- "44100" 
caml sbitsper sample 0 " 16" caml icodectypeo" PCM" /> 

</aeq* 

</par> 
40 </body> 

</ Brail* 

45 

- <par> 

- <seq ti tie- "d3_l. tact"* 

<text id»"40" Ire- "camlt this" caml toff set»"1163597a° camlt length- "53" /> 
c/seq* 

50 - <eeq title- "d3_l .wav"* 

< audio id- "42" arc- ■ caml t thia" caml x offset- 1 11636031" caml » length- "2 B 03056" caml • channels- n 2" caml tsamplerate- "44100" 
camlibitBper8ample«"16" carol i codectype-" PCM* /* 

</seq> 

</par> 
55 </body* 

</amil> 

</segmexit* 

- <segment id- "43" prev_primeaegment-"39" prev_6tory-"17" level- "1" last-"yes«> 

- <smil xmlnB»"httpt//www.w3.org/TR/REC-srail tt * 
60 - <body» 

- <par> 

- <seq title- »d3_2.txt"> 

<text id- M 44" ore- "camlt this" camlt of feet-" 1443 9087° caml » length- "22 9" /> 
</seq> 

65 - <aeq title-*d3 2 .wav M > 

caudio idB"46"~Brc-"caml»thiB" caml ■ offset- "1443 9316". camlilength-"562692 n caml* chonnelo-"2" caml t samplerate- " 44100" 
camltbitspersample=»"l6" caml tcodectype-" PCM" /> 
</aeq* 
</par> 
70 </body» 
</smil> 
</ segment » 
</content-item> 
«/caml* 



75 



85 



95 



100 



- ^segment id-"39» next_priraeEjegment- * 43 " prev^riroeBegment-n?" prevj»tory-»l7" level-»l" first»"yes"* 

- «srail xralna«"h.tt:ps //wwv.w3 . org/TR/REC-smil" > 



5. caml. language Document Type Definition (DTD) 
This section is normative. 



80 <i— — — — — — 

< 1 - - CAML DTD o— — . 
«I— file i caml.dtd 



This is Command Audio Markup Languago (CAML) 

Copyright 2001 Command Audio Corporation. All Rights Reserved. 



permission to use, copy, modify and distribute the CAML DTD and its accompanying documentation for any purpose and without fee is 
hereby granted in perpetuity, provided that the above copyright notice and this paragraph appear in all copies. The copyright 
90 holders make no representation about the suitability of the DTD for any purpose. It is provided "as is" without expressed or 
implied warranty. 



Author i CAC 

Revisiom JXdi caml.dtd.v 0.1 3000/11/10 11 I 16»46 Bxp $ 
please use this formal public identifier to identify this DTDt 
"-//CoramandAudio//DTD CAML/ /EN" 
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<1— First we Include the necessary SMIL modules. 
caml supports the lightweight multimedia 
features defined in SMIL language. This profile includes 
^ the following SMIL modules: 

SMIL 2.0 BaslcLayout Module 
SMIL 2.0 BasicLinking Module 
SMIL 2.0 BasicMedia and NediaClipping Modules 
SMIL 2.0 Structure Module 
10 SMIL 2.0 Basic InlinTiming, SyncbaseTiming, BventTiming, 

MinMaxTiming and BasicTimeContainers Modules 
SMIL 2.0 BasicContentOontrol and skipContent Control Modules 

— > 

15 <( ENTITY % MS. prefixed "IGNORB" > 

< ! ENTITY % SMIL. prefix *" » 

«|— Define the Content Model --> 
<! ENTITY % smil -model .mod 
20 PUBLIC "-//W3C//ENTITIBS SMIL 2.0 Document Model 1.0//EN" 

• smil -mode 1-1. nod" > 

< I -- Modular Framework Module — 

< I ENTITY % smil- framework, module " INCLUDE ■ > 
25 < I (%srail-£ramework. module; [ 

< 1 ENTITY % smil- framework. mod 

PUBLIC "-//W3C/ /ENTITIES SMIL 2.0 Modular Framework 1.0//EN" 
* smil -framework- 1. mod" > 
tsmil -framework .mod; } ] > 

30 

< I ENTITY * layout -mod 

PUBLIC "-//W3C//BLEMENTS SMIL 2.0 Layout //EN" 
"SMIL - layout . mod" > 
% layout -mod j 

<1 ENTITY % link-mod 

PUBLIC "-//H3C//BLEMENTS SMIL 2.0 Linking//BN" 
"SMIL- link .mod" > 
% link -mod r 

40 < ! ENTITY % BasicLinkingModule " INCLUDE" > 

< 1 ENTITY % media-rood 

PUBLIC "-//W3C/ /ELEMENTS SMIL 2.0 Media Objects//EN" 
"SMIL-media. mod«> 
45 Imedia-mod; 

<i entity % struct-rood 

PUBLIC " - / /W3C/ /ELEMENTS SMIL 2.0 Document Structure/ /EN" 
"SNIL-struct .mod"* 
50 %struct-mod; 

<1 ENTITY * timing-mod 

PUBLIC "-//W3C//ELEMENTS SMIL 2.0 Timing//EN" 
•SMIL-timing . raod'»> 
55 % timing -mod; 

< \ ENTITY % control -mod 

PUBLIC "-//W3C/ /ELEMENTS SMIL 2.0 Content//EN" 
" SM IL - contr o 1 . mod" > 
60 % control -mod; 

<1— Now we define the CAML elements- -> 

65 < I ELEMENT caml ( content - item* > > 

< 1 ATTLZST caml %Core .attrib ; 

% II 8n. attrib; 

caml -length CDATA ft REQUIRED 

dialect CDATA ft REQUIRED 



35 



70 



Caml Core, lien, caml -length, dialect 

Content -item Core, HBn, type, contentid, expiration- time, edition- time, announce -time 



75 Segment Core, I18n, next_etory, prev_otory, next_prlmesegraent, prev_primesegment, down_level, up^level, first, last, level, 
assoc_content_id, cif_type, EPG_title ( ~BtatU8_mask, availability_prompt , prompt_alias 

80 

< I ELEMENT content -item (segment*) > 
< 1 ATTLIST content -item 
%Core. attrib; 

%Iien. attrib; 

85 type CDATA # REQUIRED 

contentid CDATA # REQUIRED 

prime- segment -count CDATA # REQUIRED 

expiration- time CDATA # REQUIRED 

edition- time CDATA # REQUIRED 

90 announce -time CDATA S REQUIRED 

< l ELEMENT segment ( smil ) > 
< l ATTLIST segment %Core. attrib; 
95 *I18n. attrib; 

up_level IDREF ft IMPLIED 

dOwn_level IDREF ft IMPLIED 

proves tory IDREF ft IMPLIED 

next~story IDREF ft IMPLIED 

100 nexOrineseginent IDREF ft implied 

prev _pr line segment 2DREF ft IMPLIED 
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first *yes' t IMPLIED 

last 'yes' If implied 

• level CDATA ^IMPLIED 

assoc_content_id IDRBF B IMPLIED 
cif_type CDATA # IMPLIED 

BPG_title CDATA B IMPLIED 

statUB_mask. CDATA # IMPLIED 

availability_prcrotpt CDATA « IMPLIED 
prcnnpt_alias CDATA # IMPLIED 



<l-end of CAML DTD — —————— — — — — — — ——————— > 

An XML Schema for CAML will be made available. 
Appendix A 

14. SMIL 2.0 Basic Language Profile 

Copyright 2000 World Wide Web consortium {Massachusetts Institute of Technology, Ins ti tut national de Recherche en Inforniatique 
et en Automat ique, Keio University. All RightB Reserved, http i //www. w3 .org/TR/ stall 20/ smil-basic.html 

Editors 

JCenichi Kubota (kubokeneial.mei.co.jp), Panasonic 
Aaron Cohen (aaxon.rn.coheneintcl.com), Intel 



The SMIL 2.0 Basic language profile defines a profile that is a baseline subset of the SMIL 2.0 language profile specification, 
and is designed to be a profile that meets the needs of resource-constrained devices such as mobile phoneB and portable disc 
players. It contains a baseline set of the SMIL 3.0 features including basic layout, linking, media object, structure, and timing 
modules . 

14.2. Introduction 

This section is informative. 

The Synchronised Multimedia integration Language (SMIL, pronounced "smile") includes powerful functionality for multimedia 
services not only on desktops but also for information appliances. The SMIL 2-0 Basic language profile should serve such a 
ubiquitous network as a baseline for audio-visual presentations. 

SMIL content authors may desire their works to ba available on a widespread variety of web clients, such as desktops, television 
sets, mobile phones, portable disc players, car navigation systems, and voice user agents. Each of these platforms has its 
specific capabilities and may require its own profile. The SMIL modularisation provide a solution to create profiles and 
extensions of the full SMIL language profile, in addition to providing the means to integrate SMIL functionality into other 
languages . 

The SMIL Basic language profile consists of a small number of modules chosen from the complete set of SMIL 2.0 modules to provide 
a baseline in terms of semantics and syntax, and assures conformance to the larger SMIL language profile specification. A profile 
for mobile and portable devices can be tailored based on the SMIL Basic language profile with or without extensions to support 
application specific features. 

The SMIL Basic language profile does not propose to restrict extension, but aims at a baseline of conformance between the full 
SMIL language profile and one appropriate for mobile and portable services. Saying that a player is SMIL Basic conformant, means 
that it can play documents at least as complex as those allowed by the SMIL Basic language profile. It may play significantly 
more complex documents. In particular, the browsers conforming to the SMIL 2.0 language profile will be automatically SMIL Basic 
compliant. Thus SMIL authoring for low power devices is easier since general tools can be used. 

14.3. Design Rationale 
This section is informative. 

SMIL Basic language profile 1b a language profile that is SMIL Host Language Conformant and may be supported by wide variety of 
SMIL players, even those running on small mobile phones. Mobile and portable devices share some common characteristics! 
? Small display i Display can render texts, Images, audio and stream data in a small area. 

? Simple input methodi Input devices may be numeric keys, arrow keys, and a select key. Some may have a pointing cursor. Another 
may have a voice interpreter. 

? Real-time embedded OSt Resources for calculation is limited by priority order of each task, so, in a SMIL player, the use of 
timers should be restricted in number and frequency, and memory should ba used sparingly. 

? Less network transaction i Network transactions, if necessary in a wireless environment, should be reduced as much as possible. 
The SMIL Basic language profile aims to meet these requirements. 

For references, see the document, "HTML4.0 Guidelines for Mobile Access" [MOBILE- GUIDE) issues guidelines for HTML content, and 
"XHTML Basic" [XHTML -BASIC] provides a minimum subset for portability and conformance. 

14.3.1. Layout 

Layout coordinates presentation of objects on the display device. Presentation on a small display has difficulty in rendering 
some objects. Layout of objects may not be able to be flexibly adjusted, nor have scroll barB. 8o, the layout should be simple 
and effective. Often the root- layout window will represent the full screen of the display. The BasicLayout Module is used and the 
more complex functionality or: the other layout modules, such as hierarchical layout regions, is not supported. 

14 . 3 . 2 . User ! nter f ace 

On a SMIL Basio player window, a user would likely use arrow keys to move focus on objects and anchors, and select the target 
that activates playback or linking. A "mouse-like" pointing cursor device might not be supported. A -move focus and select- is a 
simple user interface for communication with the SMIL player. The "mouse-click" user action can be mapped to an "activate" 
action. While a user is handling the focus, the player may slow or pause its timeline. 



14.3.3. 'liming ana ojracnroniBatwa 

The SMIL Timing and Synchronisation Modules present dynamic and interactive multimedia according to a timeline. The smil timing 
model is expressed in a structured language. The timeline of SMIL Basic presentation may need to be processed with limited memory 
and processing resources of mobile devices. For example, recursive function calls caused by nesting elements and memory 
allocation for additional timelines should be restricted. 

To achieve this, the SMIL Basic language profile has restrictions on use of the SMIL Timing. The restrictions arei 
Time attribute values only allow single begin and end conditions. Lists of begin or end conditions are not allowed. 

©q In addition, the SMIL Basic profile may nesd to have no concept o£ a time container except a root time container. A time 
container groups media objects into a basic unit within a local time space, and this may increase the processing complexity of 
the document beyond device capabilities. If the document includes time containers, the nesting depth of time containers may need 
to be limited. Also it may be required to limit the number of characters or elements. The SIMM Working Group requests feedback 
from users of SMIL Basic on these points. 

Time attributes support the basic timing for an element. Timing attribute values support a synchronization-baaed timeline. 
Enriched players may support event values, for example, like "click" to start presentation. This kind of simple event timing is 
useful and is usually easy to support, and so is included in SMIL Basic profile. 

14.3.4. Media Object 
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The BasicMedia Module specifies the location of the media that constitute the contents of the presentation. Here we assume the 
presentation to be an audio/ visual multimedia presentation composed of media ouch as text, images, audio and video. 

14.3.5. Content Control 

The 6MIL Basic profile includes the BasicContentControl Module. For the sake of authoring consistency, a SMIL document should be 
able to contain several presentation for different kinds of clients, controlled by switch elements and test attributes. A client 
application may not need to directly support content control mechanisms, since the content control processing of the document may- 
be done on the way to the client. When SMIL Basic is used in this way, the player may be thought of as the system composed of the 
combination of the server and the client. 

Test attributes of the BasicContentControl Module are included in the SMIL Basic language profile, even when an alternative to 
the CC/PP mechanism is necessary. The player should analyse switch element syntax correctly even if it cannot recognize the test 
attributes . 

15 Some functionality of the Content Control Modules may be extended with CC/PP ICC/PP] mechanisms, which provide a way to notify 
device capabilities and user preferences to an origin server and/or intermediaries such as a gateway or proxy. This allows the 
generation or selection of device- tailored contents. Thus CC/PP can be used with transformation of available documents between 
client and server. 

20 14.3.6. Accessibility 

There axe useful guidelines to handling accessibility issues that can be applied to the profile design for information 
appliances. The document, "Accessibility Features of SMIL" CWAI -SMIL -ACCESS ] , summarizes their recommendations on the SMIL 1.0 
[SMXL1] 

25 14.3.7. Use of the SMIL Basic language profile 

SMIL Basic language profile is designed to be appropriate for small information appliances like mobile phones and portable disc 
players. Its simple design is intended to serve as a baseline profile for application specific extensions. Similar to the 
XHTML+SMIL language profile, an HTML+SW2L mobile profile could be written that is an integration of SMIL Basic timing and media 
functionality into the HTML mobile profile. 

30 

The SMIL Basic -language profile does not restrict extension and inclusion of other modules, for example, the Animation, 
Metainformation, Transition, or additional Timing and Synchronization Modules. A language may support additional features and 
modules and still be conformant with the SMIL Basic language profile. 
14.4. Definition of the SMIL 2.0 Basic Language Profile 
35 This section is normative. 

14.4.1. Conformance Criteria 
Conforming SMIL 2.0 Basic Documents 

A SMIL 2.0 Basic document is a "Conforming SMIL 2-0 Basic Document" if it adheres to the specification described in this document 
40 including SMIL 2.0 Basic dtd and also. 

The root element of the document is a smil element. 

Conforms to the "Extensible Markup Language (XML) 1.0" fXMLlO] specification, the document is well-formed. 

45 A document must declare a default namespace for its elements with its xmlns attribute at the Brail root element. The SMIL 2.0 
Basic language profile document is identified with "httpi//www.w3 .org/Ta/EEC-smil/2000/BMIL20/Basic" URI. For example' 
<smil xralnso-httpi//www.w3 ,org/TR/RBC-smll/2000/SMIL20/Basic , '> 

</smil> 

50 To use modules that are not specifically included in the SMIL 2.0 Basic language profile, they must be identified as being from 
the SMIL 2.0 namespace. 

Por example, a SMIL 2.0 Basic document extended to use the brush element from the SMIL 2.0 BrushMedia Module* 
< stall xmlns -"httpi/ /www. w3 .org/TB/REC-smil/2000/SMIL20/Baaic" 
55 xmlns, smil2-»http« //www. w3 .org/TR/REC-srail/2000/SMIL20/«> 

<smil2 thrush color»"red' begin^lCs* duro n 20s"/> 
</snd>l> 

60 A document may additionally identify itself as a valid SMIL XML document with a SMIL DOCTYPE declaration, although a SMIL 2.0 
Basic document must still include the above SMIL 2.0 Basic namespace identifier. 

The SMIL 2.0 Basic language profile DOCTYPE io. 
< ! DOCTYPE SMIL 

65 PUBLIC "-//W3C//DTO SMIL 2.0 Basic//EW" 

* ht tp * / /www . w3 . or g/TR/RBC- erai 1/ 20 0C/SMIL2 OBas ic . dtd" > 
This BOCTYPK declares a valid, extension- free , SMIL 3.0 Basic document. The rules above will be updated once an XML schema for 
SMIL 2.0 Basic language profile is available. 

70 Conforming SMIL 2.0 Basic Players 

A SMIL 2.0 Basic player io a program that can parse and process a SMIL 2.0 Basic document and render the contents of the document 
onto an output medium. 

75 The following criteria apply to a "Conforming SMIL 2.0 Baoic Players" • 

? The player must parse a SMIL Basic document and evaluate its well-formedness conformant to the XML1.0 Recommendation [XML10] . 

? The player must conform to functionality criteria defined in each module in ways consistent with this profile specification. 

? The player should support the semantics of all SMIL 2.0 Basic language profile features. 

? The player ignores unknown elements under support of skip-content attributes. 

85 1 The player ignores unknown attributes. 

r For an attribute with an unknown attribute value, the player euhstitutes the default attribute value if any, or ignores the 
attribute if the attribute has no default value. 

90 14.4.2. SMIL 2.0 Basic Language profile 

The SMIL 2.0 Basic language profile supports the lightweight multimedia features defined in the SMIL 2.0 specif ication. This* 

language profile includes the following smil 2.0 Modules t 

? SMIL 2.0 Layout Modules BaaicLayout* 

T SMIL 2.0 Linking Modules BaaicL inking* 
95 ? Smil 2.0 Media Object Modules — BasicMedia* and MediaClipping 

? SMIL 2.0 Structure Module — Structure* 

7 SMIL 2.0 Timing and synchroni ration ModuleB — BaslcinllneTlming*, syncbaseTlmlng* , BventTiming, MinMaxTiming* , and 
BaaicTime Containers* 

? SMIL 2.0 Content Control Modules BasicContentControl" and SkipcontentControl* 
100 (*) - required modules in order to be SMIL Host Language Conformant. 

These collections Of elemento are used In the following sections defining the SMIL 2.0 Basic profile's content roodol. 



80 
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Collect: ion Name Elements In collection 
LinkAnchor a. area (anchor) 

MediaContent text, img, audio, video, ref, animation, textstream 

schedule par, seq 

EMPTY 

Collections of attributes used in the tables below are defined as follows i 

Collection Name Attributes in Collection 
Core id, claso, title 

Timing begin, dur, end, repeat (deprecated) . repeatCount, repeatDur, min, max 
Description abstract, author, copyright 

I18n • xmltlang 

Test systemBitrate(system-bitrate> , sys terocapt ions (system- captions ) , systemLanguage (system-language) , 

systemOverdubOrSubtitle(syatem-OTexdub-or-caption) , ay otemRequi red ( ays tera- required) , syotemScreenSise<Bystera-Bcreen-ei*e) , 
systemScreenDepth (system- screen-depth) , systemAudioDesc, systemOperatingSystem, syetetncpu, systeraComponent 
14.4.3. Layout Nodules 

The Layout Module provides a framework for spatial layout of visual components. The SMIL 2.0 Basic profile includes the SMIL 2.0 
BasicLayout Module. This profile requires layout type of ■ text/smil -basic- layout " . 

Elements Attributes Content Model 

layout Core, XlBn, type ( root-layout?, region* ) 

region Core, UBn, backgroundColor (background- color) , height, width, bottom, fit, left, right, top, * -index, shovrBackground 



root-layout Core, IlBn, backgxoundColor (background- color) , height, width EMPTY 

Default of the sice and position attributes is the full screen available to a client player. The default value of the fit 
attribute is "hidden" . so when a player cannot layout a media object of target, then it presents the object as is inside the 
region. 

14.4.4. Linking Modules 

The Linking Module describes the hyperlink relationships between content. The SMIL 2.0 Basic profile includes the SMIL 2.0 
BasicLinking Module. 

A SMIL Basic player may not be able to control links between the source and the destination object, for example, in applying 
sourceLevel and destinationLevel attributes to volume. In this case it is permitted that the attributes of target control, which 
are listed in the table below, are juBt ignored. As a consequence, the attributes of the SMIL 2.0 BasicLinking Nodule might be 
replaced with their default attributes. The default value fox show attribtue is "replace" and the sour cePlay state attribute io 
ignored, see their definitions for detail. 

The area element and the deprecated anchor element nay not need to be supported if the device does not have an appropriate user 
interface, in which case the smil Basic player should play the presentation without the area map. 

Elements Attributes Content Model 

a Core, I18n. href, show, source Plays tate, destinationPlaystate, sourceLevel, destinationLevel, accesskey, tabindex, 

target, external, actuate Medi eContent* 

area (anchor) Core, IlBn. Timing, alt, coords, href, show, BOurcePlaystate , destinationPlaystate, sourceLevel, 

destinationLevel, accesskey, tabindex, target, external EMPTY 

14.4.5. Media Object Modules 

The Media Object Modules provide a framework for declaring media that constitute the content b of a SMIL presentation, and specify 
their locations. The SMIL 2.0 Basic profile includes the SMIL 2.0 BasicMedia and HediaClipping Modules. 

Elements Attributes Content Model 

text, img, audio, video, animation, textBtream, ref Core, IlBn, Description, Timing, Test, ore, region, fill, alt, 

longdesc, type, clipBegin (clip-begin) . clipEndt clip -end) area(anchor) 

Elements of the BasicMedia Module have attributes describing basic timing properties of contents. For timing, the begin and end 
attributes should have one attribute value for a single timeline. 

14.4.6. Structure Module 

nt. The SMIL 2.0 Basic profile includes the SMIL 2.0 Structure 

The struct ore element body is implicitly defined to be a seq time container as in the sneli.o and SMIL 2.0 language profiles, and 
this is true in SMIL 2.0 Basic profile as well. 

Elements Attributes content Model 

smil Coro, I18n ( head?, body? ) 

head Core, I18n ( layout? | switch? ) 

body Core, I18n ( Schedule | switch | HediaContent | LinkAnchor )* 

14.4.7. Timing and Synchronisation Modules 

The Timing and Synchronisation Modules provide a framework for describing timing structure, timing control properties, and 
temporal relationships between elements. The SMIL 2.0 Basic profile includes the basic functionality of the SMIL 2.0 Timing and 
Synchronization Modules (SMIL Timing Modules). It is based upon the smil 2.0 BaaidnlineTiming, syacbaseTiming, BventTiming, and 
BaBicTimeContainars modules. 

eoThe SYMM Working group desires feedback on the need to limit the complexity of SMIL Basic document b in order to ensure that 
they can be played on low power devices. Until recently, we have been considering limiting the use of time containers to one top- 
level container, but this now appears both insufficient in limiting document complexity and too restrictive to authors. We would 
like feedback from implementers on what limitations on complexity are necessary. 

Time containers are basic units in synchronization defined in the SMIL Timing Modules and they group elements with 
synchronization relationships, in a SMIL Basic document with single time container, par and seq time container elements contain 
media object elements and should not have other tine container elements nested inside them. 

Attributes of the SMIL Timing Modules apply to elements of the SMIL 2.0 BasicMedia Module, Basics of timing are described in the 
SMIL Timing Modules. Control of element start/end time is available with the begin, dur, and end attributes. For repeating 
elements, the deprecated repeat attribute, the repeatCount and repeatDur attributes are available. 

The begin and end attributes contain the offset-value, syncbase- value, Bmil-i.o-syncbase- value, and event-value attribute values 
as single conditions. The SMIL Basic profile includes the BventTiming Nodule, which includes "activateEvent" or "click". These 
events are mapped to "activate* user action to select a focused element in a SMIL Basic player. 
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As Cor the SMIL Tinting Modules Cor the SMIL 2.0 Basic, there is only one attribute value in begin and end attributes, not a 
semicolon-separated list, in order to create a single flat timeline. 

Elements Attributes Content Model , 

par Core, HBn, Description, Test, Timing, endsync, sill, region ( switch | MediaContent | Schedule | LinkAnchor 

)* 

seq Core. Ilfln, Description, Test, Timing, fill, region ( switch [ MediaContent | Schedule | LinkAnchor )• 

The default value of the endsync attribute is "last" . The default value of the fill attribute depends on the element type as 
described in the SMIL Timing Modules. 

14.4.8- Content Control Modules 

The Content Control Module provides a framework for selecting content. The SMIL 2.0 Basic profile includes the SMIL 2.0 
BasicContentControl and SkipContentControl Modules. The skip-content attribute, which default value is "true", applies to SMIL 
2.0 elements that were not a part of SMIL, l.o, and to elements that it was applied to in SMIL 1.0, and to elements currently 
empty in SMIL 2.0 but could be made non-empty in the future, following the definition in the module. 

A SMIL Basic player must process the syntax of a Bwitch element correctly even if the player could not evaluate the Test 
attribute in a media object element properly as the attribute implies. Test attributes that cannot be evaluated will default to 
false. 



Elements Attributes Content Model 

switch Core, HBn ( < LinkAnchor J MediaContent )* | Schedule* | layout* > 

14.4.9. XML Namespace Declartions 

XML Namespace declarations using the xmlns attribute are supported on all elements in the SMIL Basic language profile. 
14.5. SMIL 2.0 Basic Language Profile Document Type Definition (DTD} 
This section 1b normative. 

The SMIL 2.0 Basic language profile DID is defined as a set of SMIL 2.0 modules integrated. 

< ! — ■»•■■«•«»---•----«•»■»——•-*——-——«———-———— — — — > 

<!-- SMIL Basic Document Module Module^»« --> 

< 1 — file i smilbaeic- model -1. mod 

This is SMIL 2.0 Basic, a proper subset of SMIL 2.0. 
Copyright 2000 W3C (MIT, 1NRIA, Keio) , All Rights Reserved. 

This DTD module is identified by the PUBLIC and SYSTEM identifiers* 

PUBLIC m -//W3C//ENTITIE3 SMIL 2.0 Basic Document Model 1.0//EN" 
SYSTEM "Blailbasic-model-l.rcod• 

Author t Kenichi Kubota, Warner ten Kate, Jacco van Ossenbruggen 

Revision* $Id: Btnilbasic-model-l.mod,v 1.27 2000/09/21 03:io$02 kkubota Exp $ 



<1 — 

ThiB file defines the SMIL 2.0 Basic Document Model. 

All attributes and content models are defined in the second half of this file . We first start with some utility definitions . 
These are mainly used to simplify the use of modules in the second part of the file. 

- - > 

< t »a»w»-:eaaaBOBoe==3» Utilt Body - Media oooooDooo=»»»*»e««xcot*oOH»»«aoi== - -> 

c J ENTITY % media-object «text| img| audio J video | animation] text at ream |ref"> 

<!-- ...... Utilt Body - Content Control ——.»--—.—•■»-»-- — > 

< ! ENTITY * content- control "switch"* 

(!.-<i.ii W »«i»»»»«< Utils Body - Linking «— — -==— — — — — — --> 

<! ENTITY % BasicLink "a | anchor | area" > 
k I ENTITY % link "%BasicLink; "> 



The actual content model and attribute definitions for each moduleeection follow below. 
- - > 

< I ENTITY % Bas id nlineTiming. module "INCLUDE"* 

< I ENTITY % MinMaxTiming .module * INCLUDE" > 

< t ENTITY % SyncbaseTiming. module ■ INCLUDE" > 

< I ENTITY % EventTiming .module " INCLUDE" > 

< i entity % Bas icTimeContainers .module ■ INCLUDE" > 

<l I %Basic InlineTiming . module / I 

< (ENTITY % basicTimeContainers "par|seq"> 

< I ENTITY % tiroeContainer "%baaicTimeContainers/ "> 

< 1 ENTITY % basicTimeContainers. content 

" (%tnedia-objectj |%con tent -control; |%link; | %basicTimeContainer»f ) *":> 
< i ENTITY % timecontainer. content "%basicTiroeContainers. content; "> 

< i ENTITY % baBicInlineTiming.attrib «%BasicInlineTiming.attrib; «> 

< I ENTITY % baoicTiraeContainers.attrib »%9aBicTimeContainero .ettrib; "> 
JI» 

< I ENTITY % timeContainer 

< I ENTITY % timeContainer. content 

< I ENTITY % basicInlineTindng ""> 

< l ENTITY t baaicTimeContainers.attrib "•> 

<l t%MinMaxTiming .module; ( 

«! ENTITY % minMaxTiroing.attrib "%MinMaxTiming.attrib/ "> 
J]> 

< \ ENTITY fc minMaxTiming.attrib •"> 

< I ENTITY Ir smil-tlme .attrib " 
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*bae i e inllnoTinlng . at t r ib r 
*rainMaxTimlng . ate rib ; 
%Pill. attrib; 



< I ENTITY % timaContainor. attrib * 
% has icInLineTiming. attrib; 
*ba B icTimeContainfirs . attrib; 
*minMaxTimixi9 . attrib; 



< I entity % par. content "%tiroeContalner. content; ■> 
<\ entity * seq. content "ttimeContainer. content/ ■* 

< I ENTITY % par. attrib » 
%tima Container. attrib; 
% System. attrib ; 

»> 

< I ENTITY % aeq. attrib • 
k time Container . attrib; 
fcsy stem. attrib; 

<I — ■■■■Ma.n.iaM.i* Content Control «»««-a-e«»«aBaaaaa-aa=aaaa«.«««-«-«»a 
<» ENTITY % BasicContentControl -module ° INCLUDE °> 

< 1 ENTITY % SkipContentControl .module • INCLUDE "> 

« I ENTITY % switch, content 
■ ( (iraedia-object ; I *link; ) * } (ttimeContainer ; ) * | layout) * > 

< I BBaaanaaaaaansaBn Layout »»ooootionon a naaaBD;cii3«ll»«>ie«!loan«iiiMiiioconD --> 

< I ENTITY % Basi ©Layout .module "INCLUDED 

* I ENTITY * layout . content * ( root- layout? , ( region) * ) M > 

< I ENTITY % region. content "EMPTY" > 

< I ENTITY % root layout. content "EMPTY" > 

< ) ENTITY % region. attrib " %skipCon tent .attrib; ■> 

< I ENTITY % root layout. attrib " %skipContent .attrib; ■> 

< I ENTITY % LinkingAttributes.nmdule "INCLUDE"* 
< I ENTITY * BaslcLinking. module " INCLUDE" > 

< I ENTITY % a. content »»<%iaedia-object; ) *»> 
< I ENTITY % area. content n empty" > 

« 1 ENTITY % anchor. content "EMPTY" > 

< I ENTITY * a. attrib "%srail~tirae. attrib ;" > 

< I ENTITY % area. attrib "%emil- tine. attrib; %akipContent . attrib t n > 
<\ ENTITY % anchor. attrib "%smil- tine. attrib/ tskipContent . attrib ;"> 

< l at.aa.»aaa«>a«*>**>«aa Media »aaB»a«a=a«»i.s.«»aaa»ooaoooOBOBoaa > 

< I ENTITY % BasicMedia. module "INCLUDED 
<! ENTITY % Media Clipping. module » INCLUDE" > 

< I ENTITY % media-object, content " (area | anchor) *■> 

< 1 ENTITY % media-object. attrib " 

%smil - time . attrib; 
tsystem. attrib; 
% Region .attrib; 



< t — Structure •»•—••»«•— ■■——>■••■»■•«-»-■■■ ■»*■•«■■ 

< IENTITY % smil. content ■ (head? , bodyT ) -> 

< I ENTITY % head-layout, content "layout | switch" > 
< {ENTITY % head. content ■ (%head- layout .content; ) ?"> 

< IENTITY % body. content " (%timeContaiaer; |%media-object; | 

% content- control/ )%link/)* M * 

< j-- K ...—c<>°«........ End of amilbaaic-model-l.mod' ««o«as«aaiaBMioBOBoao»o — > 



<l— "> 

<|~ SMIL 2.0 BaaiC DTD «««»—«— — — > 

<!-- filet SMIL20Basic.dtd 

This is SMIL 2.0 Basic, a proper subset of SMIL 2.0. 

Copyright 2000 World Wide Heb Consortium (Massachusetts institute of Technology, institut National de Recherche en informatlque 
et en Autoraatique, Kaio University. All Righto Reserved. 

Permission to use, copy, modify and distribute the SMIL Basic DTD and its accompanying documentation for any purpose and without 
fee is hereby granted in perpetuity, provided that tha above copyright notice and thia paragraph appear in all copies. The 
copyright holders make 

no representation about the suitability of the DTD for any purpose. 

It ie provided "as is" without expressed or implied warranty. 
Author* Jacco van cesenbruggen, Kenlchi Kubota 

Revision i $Xdt SMIL30Basic. dtd, v 1.3 2000/09/21 11 1 16. 46 jvanoss Exp $ 
- -> 

<|-- This is the driver file for the SMIL Basic DTD. 

Pleaee use this formal public identifier to Identify iti 
"-//W3C//DTD SMIL 2.0 Basic/ /EN" 

--> 

< I ENTITY * NS. prefixed "IGNORE" * 
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< t KNTITY % SMIL.profix »■ > 

<| — Define the Content Model — > 
< I ENTITY % ami 1 -model .mod 

PUBLIC "-//W3C//BNTITIES SMIL 2.0 Basic Document Model 1.Q//EH" 
"cmilbaoie -mode 1-1 .mod" > 



< I -- Modular Framework Module — > 

< I ENTITY % sinll- framework .module " INCLUDE' > 
<) t%smil-f ramework. module ; ( 

cl ENTITY % emil* framework .mod 

PUBLIC ■ -//W3C//BNTITIES SMIL 2.0 Modular Framework 1.0//EN" 
«• amil -framework- 1 .mod" > 
%smil-f ramework. mod; ] ] > 

<| — The SMIL 2.0 Basic Profile supports the lightweight multimedia 
features defined in SMIL language. This profile includes 
the following SMIL modules » 

EMIL a.O BasicLayout Module 

SMIL 2.0 BaslcLlnking Module 

SMIL 2.0 BasicMedia and MediaClipping Modules 

SMIL 2.0 Structure Module 

SMIL 2.0 BasicInlinTiming, SyncbaeaTiraing, EventTiraing. 

MinHaxTiming and BaoicTiraeContainere Modules 
SMIL 2.0 Basi eContent Control and skipContentControl Modules 

— > 

< 1 ENTITY % layout-mod, 

PUBLIC "~//W3C/ /ELEMENTS SMIL 2.0 Layout//EN" 

"SMIL-layout .mod"> 
% layout -mod/ 

< I ENTITY % link-mod 

PUBLIC " - / /W3C/ /ELEMENTS SMIL 2.0 Linking//KN" 

»SNEL-link.mod»» 
% link-mod; 

< \ ENTITY % BasicLinkingModule •«INCLuD3 ,, > 

< I ENTITY % media-mod 

PUBLIC B-//H3C//ELBMENTS SMIL 2.0 Media Objects//EN» 



%media-mod; 

< I ENTITY % Struct -mod 

PUBLIC »-//W3C/ /ELEMENTS SMIL 2.0 Document Structure//BN» 

"SMIL- a truct .mod" > 
tstruct-mod; 

<1 ENTITY % timing-mod 

PUBLIC "-//H3C//ELEMBNT6 SMIL 2.0 Timing//EW« 

"SMIL- timing .mod" > 
% timing-mod; 

< I ENTITY % control -mod 

PUBLIC "-//W3C/ /ELEMENTS SMIL 2.0 Content//BN» 

"SMIL- control .mod" > 
% control -modr 



(SMILU -synchronised Multimedia integration Language (SMIL) 1.0 Specification", Philipp Hoschka, editor, 15 June 199S, 
available at http i//www.w3 .org/TR/REC-smil/ 

[SMIL2J "Synchronized Multimedia Integration Language (SMIL) 2.0 Specification", Jeff Ayars et al, editors, 05 June 2001, 

available at http i/ /www. w3 .org/TR/ ami 120/ 

[MOBILE-GUIDE] »HTML4.0 Guidelines for Mobile AcceSB". T. Xaroada, Takuya Asada, Masayaau Ishikawa, Shin*ichi Mateui. W3C Note 15 
March L999, available at h t tp i / /www. w3 .org/TR/NOTB-h tml40 -mobile 



[XHTML -BASIC J "XHTML Basic", Masayaau Ishikawa, Shinichi Matsui, Peter Stark, Toahihiko Yamakami. W3C Recoamendation 19 
2000, available at ht tp./ /www. w3 . org/TH/xhtml -basic/ 

[WAI-SMIL-ACCESSI "Acceoaibility Peatvree of SMIL « Marje-RiittaKoivunen, Ian Jacobs. W3C NOTE 21 September 1999, available at 
http i //www . w3 . org/TR/ SMIL- access 

[CC/PPl "CC/PP", technology of the H3C Mobile Interest Group. H3C Note 27 July 1999, available at httpi//vww.w3 .org/TR/NOTB- 
CCPP/ 

[XML10J "Extensible Markup Language (XML) 1.0" .T. Bray, J. Paoli and cm. sperb erg- McQueen. W3C Recommendation, 10 February 
1998, available at http.//www.w3 .org/TR/RSC-xml 
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1 . introduction 

1.1. Purpose 

30 the purpose of this document is to establish functional requirements and performance specifications for the ODA Studio 

1.2. Audience 

The intended audience for this document is Command Audio's management, operations, engineering, and software programming staff. 
This document will also serve as a basis of agreement between these parties as to the system's functionality and performance 
levels 
35 1.3. Scope 

The scope off this document will include constraints, functional requirements, and performance specifications. 
1.4. Definitions, Acronyms, and Abbreviations 

Audio -On-Demand Service A service that enables listeners to choose the programming they want to hear, whenever they want 

and wherever they are. 
40 Block Indicates the type of compression in an audio layer 

CAML Command Audio Markup Language (a derivative of XML) 

CAMli object . _ ,_ 

cam I j element i The basic program building block in the ODA Studio Composer. An element can be a segment, layer, or block. 

45 CAML header element CAML header elements allow introductory details of a program to be placed separately from the main story 
CAML detail element* CAML detail elements allow additional content relating to header elements to be placed in this 

area. 

Compound Segment A segment which contains more than one segment 
Content Material fortransmission to Command Audio -enabled devices. 
50 Layer Represents multiple types of media, Buch as audio, text, image or video 
Program Playable content made up of elements 

Prine Segment Smallest navigational unit, made up of one or more layers 

CA Command Audio Corporation 

55 oda studio on-demand Authoring studio 

2 . System Overview 
2.1. Explanation 

The On-Demand Authoring (ODA) Studio is an editing software responsible for creating On-Demand Interactive Audio. Individuals use 
ODA to produce programs in a way that enables liotenero to choose their programming and the specific stories within those 
60 programs which interest them. 

The ODA Studio ie created with the express intention of creating these navigable programs. 

Single level end two- level programs can be created in the ODA studio. Single level programs provide fewer navigation 
65 opportunities than two- level programs. Two-level programs may include headers: the introductions to various stories within the 
program, and details i the specific stories which relate to the headers. 

3. Design Considerations 

3.1. Assumptions and Dependencies 

70 7 The ODA Studio runs on the Windows 2000 Operating System 

7 The ODA Studio should require minimal modifications for eaoh system in which it is installed 

7 End users will include Command Audio Production staff, as well as Production Staff or Broadcasters at Command Audio -partnered 
companies. End users will have the capability to put together programs from multimedia sources for transmission to Command 
Audio -enabled devices. 

75 ? The ODA Studio is not designed as a comprehensive replacement for other editing programs on the market, but instead is 
developed solely as a vehicle for creating Command Audio Content. 

3.2. Related Software or Hardware 

3.3. General Constraints 

7 For optimum editing, wave file size should not exceed XXNb 
80 7 Files in Content Explorer should be protected so that only one user may change contents at any one time. 

3.4. Goals and Guidelines 

? Should easily adapt to other partners' software 

3.5. Development Methods 
? written in C++ 

85 7 Once it was decided that the ODA studio would operate on a windows platform, Active X controls were chosen to distinguish the 
functional capabilities of each part of the studio. 



90 



95 



too 



4. Architectural Strategies 
4.1. System Architecture 

The ODA Studio was conceived as a replacement for the current Command Audio editing system. ENCO. One of the main benefits of 
the ODA Studio is the flexibility it offers. The ODA studio includes 4 components t 

7 Content Explorer displays multimedia files which are used to create a program 

7 Composer provides a visual stage to compose content. The Composer is made up of a Navigation View, Compression View, and 
Multimedia View. 

7 Prompter text content can be created and exieting text files can be opened. 

7 Waveform Editor is the place where audio files are edited and segmented into On Demand interactive Audio. 
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? segment audio programs specifically for Command Audio-enabled receivers. 



4.2. Programs which can be created in the ODA Studio 

4.3.1. Type one i 

A program which requires minimal processing, may only need to be marked for compression. It is comprised of one prime segment 
only hut contains at least one media layer. For example, the prime segment could contain a music track, associated textual 
Information about the singer and writer, and an image of the singer. There are no navigational elements in a prime segment. 

4.2.2. Type two» 

A single level program which can be linked in such a way that a listener can navigate between different segments. Bach of the 
segments is a prime segment capable of having several media layers. The navigation is sequential. For example, a listener can 
listen to story 1, ship stories 2 and 3, listen to story 4, and go back to hear story 2 by scanning back through 3. 

4.2.3. Type thxeet 

A two level program which allows additional navigation options. The program consists of a sequence of headers with associated 
detail segments. The user can now navigate from header to header or can navigate from a header to the associated detail, instead 
of only being able to navigate between segments, a listener can navigate story headlines (headers) before deciding if they are 
interested in hearing the details behind the headlines. These programs allow a listener to navigate back and forth through 
headers and details in the program segments 

4.2.4. Type four i 

The fourth type of program is a type three program offering the user even more navigational options. The user can essentially 
navigate even within a header or a detail segment. The segments are marked in such a way that the listener can navigate within 
the headers and details. If there are two separate thoughts in the headline, these might be marked in such a way that the 
listener could skip, forward, rewind within headers. The segments are marked in such a way that the listener can hear/choose 
specific portions of the details as well. 
4.3. ODA Studio Container and ActiveX Controls 
The ODA Studio Container hosts 4 ActiveX controls • 

? Content Explorer Control displays the content required to build the output multimedia CAML objects, and provides the ability to 
drag and drop these objects into other parts of the ODA Studio. Examples of this content include: audio programs, earcons, texts, 
images etc. 

? Prompter Control is the ActiveX component that allows text related to a specific audio recording to be created or edited 
? Waveform Editor Control is responsible for multiple functions of editing audio files {wave files) 
? Composer Control provides functionality for composing a CAML multimedia object from multiple source components. 
4.3.1. waveform Editor 

Presently, Waveform Editor Control is implemented within ATT, framework. It utilizes OLE Drag And Drop for exchanging wave files 
with other components. It uses DirectSound API for accessing the system's audio resources. NFC is used for rendering waveforms 
and GUI. 

? Ability to have two playback modes. In Mode 1, cursor moves across the waveform in sync as the waveform scrolls forward. In 
Node 2, waveform view does not scroll forward when cursor reaches right edge, but playback continues. 

4.3.1. x. Recording 

? Ability to indicate recording is in process by illuminating the record button and peek meter 

7 Ability to pause and resume recording by selecting pause or play. 

? Ability to save wave file by using windows keyboard shortcuts or file menu 

4.3.1.2. Basic Editing 

? Ability to rewind, play, stop, pause, forward, zoom in and zoom out using buttons on the toolbar 

? Ability to undo last action (actions to be defined later) using a button on the toolbar or a keyboard shortcut like Ctrl Z 

4.3.1.3. Scrolling and Selecting 

? Ability to scroll left and scroll right using arrows on the keyboard or the mouse and scrollbar 

? Ability to zoom the wave into at least 100th of a second, and zoom out to view the entire waveform using the soom in/ out 
buttons on toolbar. 

? Ability to select sections of the wave using the mouse and Ctrl key. 

T Ability to adjust the selection by single pixels from the left or right border using keyboard arrows and the shift key 

4.3.1.4. segmentation 

? Ability to insert/ delete markers and compression blocks into imported waves by right clicking with the mouse 
? Ability to keep markers consistent even if audio between them has been removed or changed. 

4.3.1.5. Copying and Pasting 

? Ability to copy and paste wave sections from the source (recording) pane to the Target pane and within the Target Pane. 

? Ability to replace selected portion of waveform with data from the internal clipboard at the insertion point by using Windows 

shortcuts . 

4.3.1.6. Playback 

? Ability to begin playback of a current selection or of the entire waveform from either the left edge of the waveform display or 
from the cursor position. 

4.3.2. Content Explorer 

Content Explorer is based on a MFC CTreeView class that simplifies the usage of the tree control CTreeCtrl, the class that 
encapsulates tree-control functionality. 

Content Explorer is a MFC ActiveX control. Its two objectives! 

? To display (in tree/branches format) media sources available for building the output multimedia caml- objects. These Bources can 
be audio programs, texts, images, commercials, etc. These building blocks can be files or records in databases. 
? To initiate a dragging mechanism when moving or copying tree items to other parts of application. 

4.3.3. prompter 

The Prompter ActiveX control provides text content for CAML objects. Prompter is a MFC ActiveX control besed on a CRichBditView 
class. CRichEditView provides the functionality of the rich edit control within the context of MFC's document view architecture. 
CRichEditView maintains the text and formatting character is tie of text. 
4.3.3.1. Basic Features 

? Ability to flag parts of text for re-evaluation later in editing process. A keyboard symbol and shortcut needs to be assigned 
to this feature so that PS can easily doublecheck and review work. Flag will remain in prompter as long as any of these remain 
in txt. PS can place notes specific to file as well. 

? Ability to differentiate comment text from script text using separate color and font and brackets. Announcer needs comment text 
to indicate pronunciations and emphasized words in script. 

? Ability to create headers and details which pertain to waveform recording by pressing Control H and Control D. 
? Ability to adjust font size and type using windows keyboard shortcuts 
? Ability to open content from content explorer and outside applications. 

f Ability to save content which has been created in prompter, as well as content which has been imported and changed in prompter 
using Windows keyboard shortcuts. 

1 Ability to scroll down through text using up and down arrows on the keyboard or a scrollbar 

4.3.4. Composer 

Composer control provides functionality for assembling a CAML multimedia object from multiple source components, composer control 
interacts with all other ActiveX controls. Its GUI depicts a CAML multimedia object composed of CAML elements. Currently a CAML 
element from GUI point of view is shown as a rectangle, and can be a prime segment or a compound segment. 
4.3.4.1. Basic Features 

? Segments can be inserted, deleted and or appended using the buttons on the toolbar. 

? When the number of segments reaches the edge of the Composer View, you should be able to scroll forward through the view. 



-25- 



WO 03/021416 



PCT/US02/27820 



Segments can be viewed in any order, moving back and forth or up and down between headers and details by using the arrow keys on 
the keyboard 



5. Subsystem Architecture 
5.1. Composer Component 

A new GUI design is implemented for 1.2 release. New features include 1 
5.1.1. Single Level program presentation 

Before creating a program, choose the type of program you wish to create. They can select a single level or a two- level program 
from an options menu, and the appropriate screen will appear. To create programs which do not require complex navigation 
capabilities, choose a single-layer program. For more complex programs, two- level programs should be created. These programs 
will be segmented so that listeners will still be able to navigate between stories. 
5.1.3. navigation View 

Tiles can be dragged and dropped, inserted, deleted, attached and appended assembled in the Navigation view. Because they are 
parts of the overall program composition, segments, layers and blocks will all be managed within the navigation view. 

5.1.3. Multimedia layer view 

You can select individual multimedia layers in the multimedia viewer. A preview pane is available to examine text, image, or 
video layers. A wave layer can still be viewed in the Waveform Editor. You can right click on a segment to view the properties 
of that segment. Properties can include 1 
7 File name 
7 Pile size 
7 Pile length 

? Date file was originally recorded 

? Name of person who last worked on file and when 

? Source of the original recording (satellite fro m . ISOH £rom , etc.) 

7 Sample rate at which it was recorded. 

5.1.4. Compression View 

The compression view displays the blocks which represent compression in a wave file. The compression view works with all parts 
of the multimedia viewer to illustrate the way the different layers fit together in a program. 

6. Skin capabilities 

6.1. User Interface images (bitmaps) requirements for ODA Studio 

The targeted resolution for the ODA Studio is 1024 x 768 pixels. The composer on the upper right band side of the studio should 
measure 600 x 330 pixels. The user will be able to choose the type of skin from a list of available skins. The properties of the 
skin can be applicable to one component or to all of tbem. Skin elements must he able to be stretched without distorting original 
image . 

6.1.1. Requirements far the Composer » 
1. A background image - ComBk.bmp 

6.1.1.1. For the Prime segment* 

? Prima segment empty selected - PriSegKS .bmp 

7 Prime segment empty unselected- Pri8eg5Us.bmp 

7 Prima segment full selected - PriSegPUs .bmp 

? Prims segment full unselected - PriSegFUs.bmp. 

? Detail: Prime segment empty selected - PriSegES (det) .bmp 

? Details Prime segment empty unselected- FriSegEUs(det) .bmp 

7 Detailt Prime segment full selected - PriSegPUs (det) .bmp 

7 Detail: Prime segment full unselected - PriSegPUs (det) .bmp 

6.1.1.2. For the Compound Segment ■ 

? A bitmap image that looks good when stretched. 

? Compound segment selected - ComSegS .bmp (should this be ComSegES.bmp) 

7 Compound segment unselected- CoraSegUs.bnp 

7 compound segment full selected - CoroSegPS.bmp 

7 Compound segment full unselected - ComSegFU.bmp 

? Detail: Compound segment selected - ComSegS(det) .bmp (ComSegB3.bmp} 

7 Detail 1 Compound segment unselected- CoraSegUs (det) .bmp 

7 Detail: Compound segment full selected - ComSegPS (det) .bmp 

? Detail: Compound segment full unselected - ComSegFU(det) .bmp 

7 Prima segment empty selected - 9riSegSS.bmp 

7 Prime segment empty unselected- PriSegZUs.bmp 

? Prime segment full selected - PriSegEUs.bmp 

T Prime segment full unselected - PriSegFUs.bmp 

6.1.1.3. ToolBar bitmap with an image for the following functions « (ComToolBar.bmp) 
7 Append 

7 Attach File 
? Delete 
7 Insert Before 
7 Insert After 
? Assemble 
7 Player 

6.1.1.4. Icons for Multimedia layer viswt 
7 icons need to be 16 X 16 pixels in size. 
7 One background image- ComLayBk 

? Tor Segment (This is in place of a "V sign in the tree view of the layer view. Tha tree view shows the layers in the segment) 
? Opened segment - ComLaySegO.bmp 
7 Closed Segment- ComLaySegC.bmp 

7 For wave file- ComLayWav.bmp 
7 For Text File - ComLayrxt.bmp 
7 For image file - ComLayIrag.bmp 
7 For Video File - ComLnyVid.bmp 
? For Animation - ComLayAni.bmp 
7 Por Compression vlewi 
? For background - ComCompBk.bmp 

7 To represent different compressions like DVSI and DOLBY in the compression view we need two more bitmaps which will look good 
when resized 1 

? To represent DVSI - ComCompDVBI .bmp 
7 To represent DOLBY - ComCorapDOL .bmp 

6.2. Requirements for the Content Explorer 1 
Background image - ConBk.bmp 

7 Icon for the main repository 

? icons need to be is x ig pixels in size. 

? Ttia following auhf older icons (We can either have a separate icon for each folder or a uniform Icon for all folders) . 

7 If we have only one icon for all folders t 
7 Con Fol C.bmp 
7 Con Fol O.btnp 

? If we have separate icons Cor each type of folder 1 
7 Audio Clips - ConFolAud.bmp 
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t Ear cans - ConFolEar.bmp 
7 Music satr^jles- ConFolMus.bmp 
? Prompt files- ConFolPxo.bmp 
7 Video files - conFolVtd.bmp 
5 7 Text Files- ConPolTxt.bmp 

? image Files- ConFollmg.bmp 
7 Wave Filos-ConWav.bmp 
? Text Files-Con Txt.bmp 
7 Music Files-Con Nus.bmp 
10 7 Animation Files-Con Avi.btnp 
? Image Files-Con Ircg.bmp 

Tbe Icons created for Multimedia layer view can be used to denote each file in the Content Explorer also. 

6.2.1. Requirements for Wave Editor t 
15 Bitmap for toolbar of target pane - WavToolbarTrg.bmp, with the following buttons 

? Rewind 

? Play 

7 Stop 

7 Pause 
20 7 Fast forward 

? Zoom in 

T Zoom Out 

? Scroll left 

7 Scroll right 

25 

Bitmap for toolbar of target pane - WavToolbarSrc.bmp, with the following buttons 

7 Rewind 

7 Play 

T Stop 
30 7 Pause 

7 Record 

? Fast forward 

7 Zoom in 

7 Zoom Out 
35 7 Scroll left 

7 Scroll right 

Bitmap for navigating handle - WavNavHdl.bmp 

40 7 . Detailed System Design 

7.1. Basic design properties 

? Hie Container communicates with a control using a set of COM interfaces. Two-way communicaticm is performed through connection 
points, advise sinks and other interfaces. 

? The ODA Studio Container has ambient properties, which allow the container to provide information to its controls. This ensures 
45 a uniform look and feel for all the Controls visible inside the Container. The Controls are supposed to react to the change of 
the ambient properties and synchronize the appearance and behavior with the other controls accordingly. 

7 The ODA Studio Controls have properties which affect the behavior of a control. They can also be used to pass data to and from 
the control. 

7 The ODA Studio Controls also support stock properties, which are standard properties like Font and Color. Standard properties 
50 are also known to the Container and therefore can be bound. Specifically, Control can inform Container that a stock property is 
about to change and allows the Container to reject the change. 

7 Control's Properties are persistent so that information Is retained when control is closed. When control is restarted, it will 
default to the settings used when last closed. 

7 The ODA Studio Controls are required to respond to ambient property changes 
55 7-2. Wove form Editor 

7.2.1. Interfaces 

Currently Waveform Editor Control exposes one interface - 
IwaveBditObj with five methods t 

60 setwavePath (BSTR bstrPath) i When a wave file is selected, the variable bstrPath passes the name of the wave file to the 
Waveform Editor. 

Play () * Commands Waveform Editor to play loaded wave file. 

StopPlayt) t Commands Waveform Editor to stop playing loaded wave file. 

Get Segment Count {long * pnCount) » Returns the number of segments in loaded wave file in variable pnCount. 

65 Get8egmentPathAt(long index, BSTR * bstrPath) » Creates wave file for the segment indicated by index and returns its path in 
bstrPath. 

7.2.2. Ambient Property Handling 

On startup the control calls ccomControl* s methods: 
70 GetAmbientBackColor, GetAmbientForeColor,GetAmbientFont to set up stock properties. 

When an ambient property changes, the Container calls 
IOLBControl t i OnAmbien tPropertyChange { ) 

on Waveform Editor Control passing DISPID of the property that has changed. The control overrides this method, obtains property 

value and handles the change. 
75 7.2.3. Custom Properties 

For setting up custom properties a property page is required. 

Initialising properties 

Persisting properties 

7.2.4. Drawing 

80 Synchronous scrolling is implemented to display a playing waveform. 
Current rendering rate is 10 panes per second. 

7.2.5. user interaction 
7.2.5.1. Targe t / Source Panes 

Waveform Editor consists of two editing panes. In the target pane, extra material from the recorded wave can be removed. It for 
85 can also be marked for scanning and compression purposes. In the lower (source) pane, sound can be recorded through a mixer for 
inclusion into the wave file in the target pane. 

Bither pane can be accessed by clicking on the left mouse button. Wave files from other applications may be dropped into the 
target pane. The target pane can also be a drag source. Drag and drop is implemented using standard OLE drag and drop mechanism. 

90 

The source pane has the same functionality as tbe target pane, and also allows for sound recording through a mixer (there is a 
'record* button In play control). Selections can be dragged outside of the control. Selections can also be dragged to the target 
pane for inclusion into an existing wave file loaded there (not implemented yet) . 

95 The target and the source panes aro separated by a splitter, which allows the pane windows to be ro- aired. 
7.2.5.3. Editing Tools 

Waveform Editor has five control buttons: "go to start" , % play" , "pause" (not implemented) , "stop", 'go to end". NBi 'record* 
button is absent in the target pane. 

100 The target pane also has four control buttons : 'zoom In", 'zoom out", "scroll back", and 'scroll forward". Scrolling is also 
possible with a horizontal scroll bar at the top of the pane. 
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The pane has horizontal rulers to measure the playback time up to a 100th of a second. The rulers change scale with window 
real sing and scroll in sync with playback. 
•7.2.5.3. Setting Markers 

5 A navigation handle indicates the current position in the wave file. Handle can be moved back or forward with the mouse. Sound 
will be played when handle is moved using mouse (scrubbing) . 

Markers can be sec to define compression blocks. Markers have the following attributes! compression (Dolby, dvsi, skip). The 
marker attributes are indicated in a dialog window. Segment markers have labels to indicate compression choice. Markers can 
tO subsequently be removed by double clicking on segment marker and pressing "Remove marker* button. 

Portions of the wove file can be selected by holding the Ctrl key down while dragging the left mouse button. Selections are 
draggable outside o£ the control. 

15 The Context menu appears when right mouse button is clicked. Menu options include setting segment marker at current mouse 
position, selection cut, copy and paste (not implemented) . 

7.3. content Bxplorer Control 

7.3.1. Drag and Drop Mechanism 

Content Bxplorer implements a MFC 0I»B drag-and-drop mechanism. When a user transfers data, using either the Clipboard or drag and 
20 drop, the data has a source and a destination. Content Bxplorer provides the data for copying and another part of application (it 
can be Composer or Waveform Editor) accepts it for pasting. The MPC provides two classes that represent each side of this 
transfers 

Data source (as implemented by COleDataSource object) represents the source side of the data transfer. It is created by the 
25 source Content Bxplorer when data ie to be copied to the Clipboard, or when data is provided for a drag-and-drop operation. 

Data object (as implemented by coleDataObject object) represents the destination side of the data transfer, it is created when 
the destination ActiveX has data dropped into it, or when it is asked to perform a paste operation from the Clipboard. 

30 Currently a well-known CP_HDROP format is used for dragging and dropping files. 
7.3.2* User Interaction 

Content Bxplorer displays all folders and files that reside in the directory called Repository. A user can drag a tree item and 
drop it onto a layer, segment, tree view or waveform editor. Text files can be dragged file into Prompter. 

7.4. Prompter Control 
35 7.4.1. Interfaces 

The prompter ActiveX control has just one _DPrompter interface. 

To get a pointer to this interfaces 
CComPtr< DPrompter> pObj; 

40 pPrompterCtrl->QueryInterface( uuidof < JDPrompter) , (LPVOID *UpObj) r 

pabj->FooMethod() ; 

Here pPrompterCtrl of type lpoleobject is a pointer to the Prompter ActiveX control . 

45 The JDPrompter interface has the following methods « 

void OnPileOpenTextO r 

void OnPileSaveTextO r 

void OnFileSaveTextAsO ; 

bstr GetDocumentPathO T 
50 BSTR GetContent ( ) ,- 

BOOL IsModifiedO; 

7.4.2. User Interaction 

A User can do the following things « 

? Open the text file from File menu and select the *Open Prompter Text* menu item. 
55 ? OR, place cursor in Prompter and begin composing text. 
? Edit the text. 

7 Text can be divided into headers and details. To insert a header marker, a user must press Ctrl and H keys at the same time. To 
insert a detail marker, a user must press Ctrl and D keys at the same time. Prompter automatically numbers headers and details 
sequentially. For example, if the last header is <Header> 5, pressing Ctrl and H keys puts <Haaders- e into the cursor position. 
60 ? Save the text using one of the following % Save As, Save prompter Text, or Save Prompter Text As, from the File menu. 

7.5. Composer 

7.5.1. Interfaces 

Currently the Composer ActiveX control has just one _DComposer interface. The following code shows how to get this interface i 
CComPtr<__pComposer> pObj / 
65 pcomposerCtrl->Query Inter face (_uuido£ ( jocomposer) , (liPVOiD *)&pObj)r 

pObj ->FooMethod < ) j 

Here pComposerCtrl is a pointer of class LPOLEOBJECT to the Composer ActiveX control. 
Currently this interface has just one methods 

SetPrompter< (UPUNKNOWN*) 6 (pPrompter) ) . The Composer ActiveX control has a member of class ColeClientltem* m__p Prompter- This 
70 method sets mjPrompter to the Prompter ActiveX control pointer. 

7.5.2. User Interaction 

Composer has the following buttons s 

Append. Appends new empty header and detail elements to the CAKL object. 

Attach. Opens a file dialog box. A user can choose a file and attach it to the selected element. 
75 Delete. EeleteB a selected element. In a two-level program, if a header is selected, its corresponding detail element will 
automatically be deleted as well. 

insert before. Inserts segment before the selected element, in a two- level program, an upper and lower element will be 
inserted . 

Insert after. Inserts segment after the selected element. In a two-level program, an target and lower element will be inserted. 
SO Play next. Plays next header element 
Play previous. Plays previous header. 

Flay down. Plays the header's corresponding detail element when a header element is selected 
Play up. Plays the detail's corresponding header when a detail element is selected. 
Stop. Stops playing a selected element. 
85 Assemble. Attaches wave segments from the source pane of the Waveform Editor control to the CAMI, elements according to the 
prompter text layout. The first segment is assigned to the first header/detail in the prompter text, and so on. 

In addition, a user can do the following things i 

? Drag a wave file from the Content Bxplorer control or Microsoft windows Explorer and drop it on a CAML element or multmedia 
90 layer in the Composer control. 

7 Drag a selected wave segment from the first pane of the Waveform Bdit control and drop it on a CAMI* element. 
? Move a file attached to a CAMI* element to another element. 

? Append a file attached to a caml element to a file attached to another element. To do it a user has to press a Ctrl key and 
raova a file at the same time. 

95 

8. Detailed Subsystem Design— D -A. V. I .D Systems 
6.1. Overview 

7ha On-Demand Authoring Center's Composer ActiveX (control) interacts with the Multitrack Editor (client). The Multitrack Editor 
is a client of the Composer. Communication between the two is bi- directional * the client controls the composer and vice versa. 
100 8.2. Composer ActiveX 
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The Composer implement o two ktndo of interfaces « incoming and outgoing. The incoming interface contains methods that are called 
by the client. The outgoing interface is used to notify the client of the control's events. It is called a sink interface, 
because it sinks event notifications. 

8.3. incoming Interface 
8.3.1. Description 

Control's incoming interface is called DComposer and is created by the MPC ActiveX Control Wizard. The current DComposer 
interface has the following methods t 

- void BSTR GetBlocks (BSTR betrOtojectiD) 

- void long OnDelete (BSTR bstrObjectlD) ; 

- void long OnDragDrop (BSTR bstrFormat, long X, long Y, short mode, BSTR bstrObject) ; 

- void OnPileNew (J ; 

- void BSTR OnGetMetadataO r 

- void long OnSetMetadata (BSTR bstrComposerMetadata) ; 

- void long SetProperties (BSTR bstrSet Proper ties) / 

The GetBlocks (BSTR bs trOb j ect ID) method returns an XML. string containing information about blocks in the object with a given 
object ID. 

The OnDelete (BSTR bstrObjectID) method is called by the client when an object is being deleted. 

Clips from the client multi-format clipboard or any track can be moved to a composer element (header or detail prime segment) . 
The OnDragDrop («.) method is repeatedly called by the client during drag-and-drop operations. The method has the following 
parameters i 

- bstrFormat represents a drag format which is an XML string with the following structure! 

- <obj octinf o> 

«ob jectid>objectid</obj ectid> 
cdur:» duration in US</dur> 

- </ object info 

X and Y are the current mouse coordinates. Using the coordinates, the Composer can determine whether the mouse Is Inside the 
particular Composer element; 

- mode indicates whether drag or drop operation occurs; 

- bstrohject is a string representation of the object id of the dragged object. 
The OnFileNew ( ) method is called to create a new project in the Composer. 

The Composer Metadata presents the structure and content of the program loaded in the Composer. The client calls the 
OnGetMetadataO method to get the Composer Metadata. The return value is a string representation of the Composer Metadata. So, 
the serialized project includes this string. The Metadata string is an XML, string. 

The OnSetMetadata (BSTR bstrComposerMetadata) method is called by the client upon loading the project. The Composer, using 
bstrCompoaerMetadato, can restore the previously saved program. BstrComposer Metadata is an XML string. 

SetProperties (BSTR betrGetProperties) is used for previewing layers selected in Multimedia Layer View. The parameter 
bstrProperties is an xml string with the following structure: 

<objectinfo 

<objectid> «/objectid> 
<dux> </dur> 
<markerinfo> 

<marker> 

<pos> </pos> * 
<title» </title» 
<type> </type» 

< /marker* 
</markerin£o> 
</ object info 

8.4. Outgoing Interface 
8.4.1. Description 

Control's outgoing interface is called _DcomposerEvents and is created by the MFC ActiveX Control Wizard. The current 
__DCoim?oserEvents interface has the following events * 

- void Edit Object (long object ID, long* result) 

- void Get Proper ties (BSTR bstr Propoescr) 

- void PlayObjact (long object ID, long* result) 

- void StopPlayObject (long object ID, long* result) 

- void SaveCurrentState<long*result> 

- void SaveObject (long object ID, BSTR path, long* result) 

- void Saves ource (BSTR SaveSourcePath, BSTR* bstrSourceName) 

- void Get File (BSTR xmlObj ect Info, long* result) 

The client (not the control) implements all these events. The Composer can only fire the events. For example, to fire SaveObject 
event the Composer executes the following code i 

Fl r ©Event (di Bp idSavedbj ect, EVENT_PARAM ( VTS_I4 VTS WBSTR) , object ID. path). FireBvent through the COM mechanism passes 
control to the client where the corresponding method is called. 

The bstrPropDescr parameter of the GetProperties event is an XML string with the structure i 

<objectinfo> 

<objcctid> < /objection 
</objectinfo> 

The Get File parameter is an XML string with the structure i 

<ob j ect in f o> 

<objectid> </objectid> 

<path> </path> 

<format> </ forma t> 
< /object info 

8.5. Client 
8.5.1. Description 

The client does the following things t 

? implements events that the Composer fires . To do this a class of type CAdvlseSink that derives Crom _ucomposerEvents has been 
created 

? launches the Composer ActiveX that allows the client to create the embedded OLE item of type CDavidClientCntntem that derives 
from COleClientltem. To do this the client needs to know just the Composer ProgID "COMPOSER .CompoaerCtrl 
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* defines the Composer position in the client area 
? gets a Composer pointer of type iConnectionPoint Container 
5 7 using the last interface finds the IConnectionPoint interface 
? creates an object of type CAdvieeSink 

? through IConnectionPoint interface calls Advise method that passes the pointer to the CAdviseSink object 
10 9. Glossary 

10. Bibliography 

1. Functional requirements 
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We Claim: 

1. A method of editing audio or video data using a display, comprising the acts of: 

providing a plurality of segments of the audio or video data; 
displaying an icon representing each of the segments; 

associating a first one of the segments with at least one other of the segments; and 

displaying an indication of the association of the first to the other of the segments thereby 
composing a program of the segments; 

wherein the program may be played in a sequence determined by a user in accordance 
with the associations. 

2. The method of Claim 1, wherein the associations are each a hyperlink. 

3. The method of Claim 1, wherein the associations are each displayed as a spatial arrangement 
of the icons. 

4. The method of Claim 1, wherein each icon when activated results in playing at least a portion 
of the segment represented by the icon. 

5. The method of Claim 1 , wherein each icon carries an identifier for the segment represented by 
the icon. 
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6. The method of Claim 1 , wherein each displayed icon is designated as a first type or a second 
type, a plurality of the second type being associated with each of the first type. 

7. The method of Claim 1, wherein each displayed icon is designated as a first type or a second 
type, a plurality of the second type associated with each of the first type or the second type. 

8. The method of Claim 1, each icon representing content selected from the group consisting of 
audio, video, image, or text. 

9. The method of Claim 6, wherein the program when played by the user plays each of the 
segments represented by an icon of the first type in a predetermined order, and allows user 
selection of playing each of the segments represented by an icon of the second type. 

10. The method of Claim 7, wherein the program when played by the user plays each of the 
segments represented by an icon of the first type in a predetermined order, and allows user 
selection of playing each of the segments represented by an icon of the second type. 

1 1. A computer system having a graphical user interface for editing audio or video data on a 
display, comprising: 

a memory storing a plurality of segments of audio or video data, 

a portion assigning an icon to be displayed representing each of the stored segments; 

a portion which associates a first one of the segments with at least one other of the 
segments, and displays an indication of the association; 

a composer which composes a program of a set of the associated segments; and 



-32- 



WO 03/021416 



PCT/US02/27820 



wherein the composed programs may be played in a sequence determined by a user in 
accordance with the associations. 

12. The system of Claim 11, wherein the associations are each a hyperlink. 

13. The system of Claim 11, wherein the associations are each displayed as a spatial 
arrangement of the icons. 

14. The system of Claim 1 1 , wherein each icon when activated plays at least a portion of the 
segment represented by the icon. 

15. The system of Claim 11, wherein each icon carries an identifier for the segment represented 
by the icon. 

16. The system of Claim 11, wherein each displayed icon is designated as a first type or a 
second type, a plurality of the second type being associated with each of the first type. 

17. The system of Claim 11, wherein each displayed icon is designated as a first type or a 
second type, a plurality of the second type associated with each of the first type or the second 
type. 

18. The system of Claim 11, each icon representing content selected from the group consisting 
of audio, video, image, or text. 



-33- 



WO 03/021416 



PCT/US02/27820 



19. The system of Claim 16, wherein the program when played by the user plays each of the 
segments represented by an icon of the first type in a predetermined order, and allows user 
selection of playing each of the segments represented by an icon of the second type. 

20. The system of Claim 17, wherein the program when played by the user plays each of the 
segments represented by an icon of the first type in a predetermined order, and allows user 
selection of playing each of the segments represented by an icon of the second type. 

21. An improvement to a computer editing system, the system allowing composition of a 
program from a plurality of audio or video segments using a graphical user interface displaying 
an icon identifying each of the segments, comprising: 

assigning links between the segments by displaying a spatial arrangement of the icons; 

the spatial arrangement representing a link between a header segment and a detail 
segment wherein the program includes a plurality of header segments played in a 
predetermined order and a plurality of detail segments played in an order of election of a 
user in response to an indication of each link. 
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<Header> 1 

A gift Crowe about 

<Detail> 1 

Russel Crowe is taking his rock band, 30 
Odd Foot of Grunts, to Texas this summer 
for a concert celebrating the 15th birthday of 
Sydney Perry, the daughter of Texas Gov. 
Rick Perry. The Aug. 18 show at Stubb's 
BBQ in Austin will benefit the city Settlement 
Home for troubled youth and will kick off a 
brief U.S. tour by the Oscar winners band- 
Crowe became friends with the governor last 
year when his band was in Austin recording 
an album and performing. 
<Header> 2 

Chelsea Clinton, dad score U2 tickets. 

<DetaiI> 2 

Bill Clinton and daughter Chelsea bounced 
to U2's beat at the Irish quartet's U.S. finale 
Friday night in East Rutherford, N J. 
Arriving as the concert started under bright 
house lights, the former president shook 
hands with excited fans. U.N. Secretary 
General Kofi Annan also was spotted in the 
celebrity holding pen on the floor of the 
Continental Arena, along with Caroline 
Kennedy, model Christy Turlington and her 
fiance' actor Ed Burns and members of 
R.E.M. 
<Header> 3 

A sneak peek at Harry Potter 1 trailer 

<Detail> 3 

The new preview for the movie Harry Potter 
and the Sorcerer's Stone will be available 
Wednesday on AOL (keyword Harry Potter) 
to subscribers . The trailer will 
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Use the "next" and "prev" buttons 
to navigate through the headlines. 
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4<Header> 1 

'If you've read the critical reaction to PBS's 
/ 10-part documentary Jazz (concluding this 
Wednesday at 9 p.m.), you know that Ken 
Burns and his crew of commentators pay 
scant attention to the post-Coltrane era. 
fDetail> 1 

' The 1 7-plus hour series devotes twice the 
I amount of time to the four years between 
/ ) 1935 and 1939 as it does to the past four 
/ / decades and hints that in recent years the 
/ / public lost interest in jazz and the form has 
/ / stagnated. Some critics have attributed this 
/ / omission to the heavy hand of "senior 
I / creative consultant" Wynton Marsalis, who 
J / heads up what might be called the neocon 
I / movement of jazz, which, broadly stated, 
/ favors returning to codified jazz traditions 
/ over pushing the boundaries of the form. 
/ f <Heeder> 2 

\ / Here's another, more innocuous theory. In 
I I Burns' series, jazz is inextricably tied to race 
/ and racial struggles, indeed, Burns has stated 
/ outright that Jazz, along with his series on 
/ the Civil War and baseball, is part of a trilogy 
/ on the theme of race in America. 
/ ^r<Detail2> 
\ f While it's relatively easy to build an early 
\ / history of jazz around an examination of 
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THE GOOD NEWS: Boron helps reduce 
risk of prostate cancer. Boron is 
found in nuts, wine, and fruits and 
veggies. 
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